-- Logs begin at Fri 2022-05-13 16:23:49 UTC, end at Fri 2022-05-13 17:49:49 UTC. -- May 13 17:06:21.086262 dv-cinder-841782-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 13 17:06:21.093780 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 17:06:21 2022] *** May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: nodename: dv-cinder-841782-1-iscsi May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: machine: x86_64 May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: clock source: unix May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: pcre jit disabled May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: detected number of CPU cores: 4 May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: current working directory: / May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: detected binary path: /usr/bin/uwsgi-core May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: your processes number limit is 47680 May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: your memory page size is 4096 bytes May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: detected max file descriptor number: 2048 May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: lock engine: pthread robust mutexes May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: thunder lock: enabled May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 13 17:06:21.097398 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 17:06:21.142222 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: Python main interpreter initialized at 0x555db1b439c0 May 13 17:06:21.142222 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: python threads support enabled May 13 17:06:21.142222 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: your server socket listen backlog is limited to 100 connections May 13 17:06:21.142222 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: your mercy for graceful operations on workers is 90 seconds May 13 17:06:21.142554 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: mapped 403077 bytes (393 KB) for 2 cores May 13 17:06:21.142663 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: *** Operational MODE: preforking *** May 13 17:06:21.142938 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: *** uWSGI is running in multiple interpreter mode *** May 13 17:06:21.142938 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: spawned uWSGI master process (pid: 80063) May 13 17:06:21.143164 dv-cinder-841782-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 13 17:06:21.145850 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: spawned uWSGI worker 1 (pid: 80072, cores: 1) May 13 17:06:21.145850 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: spawned uWSGI worker 2 (pid: 80073, cores: 1) May 13 17:06:21.145850 dv-cinder-841782-1-iscsi devstack@keystone.service[80063]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 17:06:26.917367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:06:26.917367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: from cryptography.utils import int_from_bytes May 13 17:06:26.918168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:06:26.918168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: from cryptography.utils import int_from_bytes May 13 17:06:26.918275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:06:26.918275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: from cryptography.utils import int_from_bytes May 13 17:06:26.918686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:06:26.918686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: from cryptography.utils import int_from_bytes May 13 17:06:26.967624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 17:06:26.967824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 17:06:26.967914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 17:06:26.968011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] command line args: [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 17:06:26.968094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 17:06:26.968241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] command line args: [] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 17:06:26.968322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 17:06:26.968447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ================================================================================ {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 17:06:26.968535 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 17:06:26.968691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ================================================================================ {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 17:06:26.968782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] admin_token = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.968938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] config_dir = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.969024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] admin_token = **** {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.969128 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.969211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] config_dir = [] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.969314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] config_source = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.969402 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.969498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] debug = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.969579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] config_source = [] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.969693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.969966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] debug = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.969966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.970125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971483 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_config_append = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] list_limit = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971782 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] log_config_append = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_dir = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971894 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.971958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_file = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.972045 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] log_dir = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.972045 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] log_file = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.972172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.972246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.972310 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.972405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.972524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.972667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.972765 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.972926 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.973022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.973103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.973185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.973264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.973337 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.973520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.973619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.973759 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.973836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.974008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.974093 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.974240 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.974386 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.974508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.974655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.974770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.974914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.975022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.975172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.975296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.975433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.975547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.975712 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.975897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] publish_errors = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.976018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.976159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.976270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] publish_errors = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.976421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.976537 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.976651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.976769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.976881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.976958 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.977080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.977236 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.977318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] standard_threads = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.977396 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.977512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.977588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] standard_threads = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.977658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.977736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.977814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.977891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.977972 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] use_journal = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.978077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.978194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] use_json = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.978281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] use_journal = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.978361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] use_stderr = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.978440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] use_json = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.978520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] use_syslog = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.978594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] use_stderr = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.978702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.978782 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] use_syslog = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.978961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.979041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:06:26.979228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.979322 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.979517 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.979602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.979736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.979823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.979991 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.980072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.980231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.980310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.980481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.980560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.980719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.980805 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.980968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.981053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.981223 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.981309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.981474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.981561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.981709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.981793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.981957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.982037 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.982246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.982329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.982431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.982512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.982683 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.982769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.982925 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.983008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.983188 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.983271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.983454 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.983619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.983709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.983894 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.983980 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.984149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.984228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.984392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.984473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.984651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.984737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.984901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.984979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.985136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.985218 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.985371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.985458 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.985604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.985684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.985842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.985923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.986077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.986156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.986318 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.986404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.986549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.986629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.986786 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.986864 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.987035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.987113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.987303 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.987412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.987543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.987649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.987822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.987929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.988039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.988171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.988295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.988401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.988504 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.988618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.988734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.988846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.988963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.989165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.989263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.989397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.989506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.989639 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.989746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.989874 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.989983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.990115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.990341 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.990441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.990576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.990683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.990817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.990933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.991040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.991179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.991308 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.991427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.991528 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.991644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.991769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.991877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.991992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.992108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.992223 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.992337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.992464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.992582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.992687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.992838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.992947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.993071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.993195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.993302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.993417 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.993534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.993649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.993763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.993906 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.994016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.994145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.994272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.994389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.994585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.994714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.994840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.994989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.995110 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.995267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.995393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.995512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.995630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.995752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.995871 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.995871 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.996667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.996794 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.996913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.997039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.997156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.997289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.997408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.997525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.997642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.997761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.997878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.998010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.998137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.998269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.998388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.998512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.998634 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.998760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.998878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.999004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.999174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.999297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.999413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.999531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.999647 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.999777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:26.999897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.000015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.000131 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.000248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.000372 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.000491 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.000614 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.000721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.000837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.000954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.001079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.001197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.001313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.001430 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.001545 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.001661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.001786 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.001906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.002022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.002137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.002253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.002368 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.002493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.002612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.002729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.002844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.002961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.003084 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.003822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.003958 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.004079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.004198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.004314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.004431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.004556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.004675 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.004791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.004907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.005024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.005142 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.005266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.005266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.external = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.005489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.005606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.005723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.005723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] auth.external = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.005954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.006082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.006226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.006226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.password = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.006460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.006579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.token = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.006697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.006814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.006940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] auth.password = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.007059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.007194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] auth.token = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.007325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.007445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.007563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.007693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.007814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.007939 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.008057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.008175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.008292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.008422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.008547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.008666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.008792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.008910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.009028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.009227 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] credential.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.009350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.009468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.009586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.009703 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.009820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.009947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.010066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.010184 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.010303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.010420 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.010538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.010664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.010783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.010906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.011025 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.011185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.011307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.011438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.011570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.011689 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.011807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.011925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.012042 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.012176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.012297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.012416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.012534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.012651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.012769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.012896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.013015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.013133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] federation.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.013250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.013369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.013494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.013621 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.013740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.013858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.013976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.014093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.014219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.014338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.014456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.014574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.014692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.014810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.014937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.015056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.015187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.015306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.015434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.015555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.015681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.015800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.015918 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.016036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.016153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.016270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.016396 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.016515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.016634 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.016751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.016869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.016986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.017112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.017230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.017347 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.017464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.017582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.017700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.017825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.017951 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.018069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.018186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.018304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.018421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.018550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.018678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.018797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.019495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.019627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.019747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.019878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.019998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.020117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.020244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.020363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.020480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.020607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.020726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.020844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.020962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.021079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.021079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.021310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.021429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.021547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.021664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.021781 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.021899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.022058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.022181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.022300 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.022423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.022543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.022660 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.022786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.022907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.023031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.023167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.023287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.023410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.023538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.023663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.023782 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.023900 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.024018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.024141 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.024268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.024387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.024504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.024621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.024739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.024864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.024984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.025102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.025219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.025336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.025454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.025579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.025697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.025814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.025932 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.026051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.026168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.026294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.026414 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.026538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.026657 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.026773 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.026890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.027015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.027166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.027287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.027417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.027535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.027653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.027779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.027898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.028015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.028134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.028251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.028369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.028495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.028614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.028731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.028849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.028966 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.029083 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.029209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.029328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.029449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.029567 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.029685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.029802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.029927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.030046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.030163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.030282 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.030390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.030495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.030619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.030737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.030855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.030973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.031142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.031268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.031399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.031523 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.031641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.031758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.031874 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.031991 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.032116 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.032235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.032353 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.032476 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.032594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.032712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.032899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.033020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.033137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.033255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.033373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.033490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.033618 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.033738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.033854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.033971 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.034089 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.034206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.034331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.034470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.034592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.034709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.034826 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.034943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.035069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.035244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.035364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.035483 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.035599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.035716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.035847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.035966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.036083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.036200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.036317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.036434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.036560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.036679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.036795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.036913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.037029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.037147 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.037272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.037391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.037514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.037634 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.037751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.037867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.037993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.038111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] resource.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.038229 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.038346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.038463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.038581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.038706 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.038825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.038942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.039059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.039190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.039309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.039447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.039447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] role.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.039674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.039789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] role.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.039907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.040024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.040149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.040269 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.040386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.040503 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.040621 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] role.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.040749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.040867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] role.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.040867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.041086 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.041086 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.041307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.041432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.041551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.041668 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.041787 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.041904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.042021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.042146 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.042264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.042382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.042498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.042615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.042733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.042859 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.042978 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.043095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.043231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.043231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.043453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.043583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.043703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.043821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.043938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.044056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.044173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.044173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.044404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.044521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.044638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.044755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.044873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.045002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.045121 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.045238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.045354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.045471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.045596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.045715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.045832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.045951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.046068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.046186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.046311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.046429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.046546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.046663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.046780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.046897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.047024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.047214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.047335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.047453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.047570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.047687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.047815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.047941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.048060 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.048177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.048301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.048419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.048544 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.048663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.048780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.048897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.049013 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] token.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.049131 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.049257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.049379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.049498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.049615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.049732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.049849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.049974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.050118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.050241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.050358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.050475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.050592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.050717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.050836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.050953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.051070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.051203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.051321 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.051451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.051570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.051687 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.051804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.051921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.052037 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.052163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.052282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.connection = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.052408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.052534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.052653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.052770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.052887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.053012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.053012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.053233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.053351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.053468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.connection = **** {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.053593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.053720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.053837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.053963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.054081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.054198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.054315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.054432 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.054549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.054674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.054792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.054910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.055027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.055163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.055283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.055415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.055535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.055653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.055770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.055887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056366 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 17:06:27.056846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:06:27.056846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 17:06:27.086128 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.086358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.086558 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.086645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.086798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.087028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.095353 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.095762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.123422 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.123654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.123984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.124224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.187092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.187820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.243909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.244079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.244168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.244245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.310045 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.310174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.310271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.310348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.310485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.310598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.310733 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.310815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.310954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.311037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.311198 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.311283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.334963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.335083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.335225 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.335311 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.335461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.335543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.335688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.335772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.335908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.335991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.336124 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.336214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.336341 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.336424 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.347714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.349556 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.360908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.361144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.361374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.361594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.361841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.362062 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.362158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.362298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.362387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.362574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.363354 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.363575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.363791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.364007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 17:06:27.380711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.380929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 17:06:27.381011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.381178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 17:06:27.381302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.381466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 17:06:27.381547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.381706 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 17:06:27.381912 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.381995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.382180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.382261 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.382450 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.382531 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.382707 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.382787 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.393675 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.393768 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.393984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.394079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.394255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.394338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.394539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.394621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.402698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.402803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.406020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.406104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.406304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.406479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.406584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.406660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.406916 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.407000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.407222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.407319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.407487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.407576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.407758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.407839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.408030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.408119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.408300 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.408381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.408572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.408652 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.408837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.408919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.435977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.436241 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.437644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.437889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.437971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.438170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.443769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.444052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.444133 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.444338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.444421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.444624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.452095 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.452293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.452388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.452579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.457018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.457271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.457353 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.457562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.457645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.457845 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.457927 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.458116 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.458195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.458390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.458472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.458667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.458747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.458933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.459021 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.459221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.477787 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.477924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.478072 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.478205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.482658 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.482743 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.486367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.486452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.486665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.486747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.492204 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.495819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.496047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.499571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.499701 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.499874 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.500006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.500160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.500295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.500444 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.500587 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.500723 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.500866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.501002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.501143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.520772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.521143 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.521283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.521414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.521569 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.521679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.521838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.522105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.529617 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.530431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.531377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.531657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.532192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.532469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.534727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.535007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.535322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.535616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.535711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.535896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.535977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.536305 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.536594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.536875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.549374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.549658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.549941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.550752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.550852 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.551033 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.551115 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.551346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.551429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.551623 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.551717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.551972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.552251 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.552531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.570313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.571358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.573883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.574907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.577235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.578265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.578841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.579898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.580518 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.580811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.581104 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.581721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.582016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.582300 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.588606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.589691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.590227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.591369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.593506 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.593797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.594082 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.594361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.594596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.594890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.595201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.595486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.603702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.603998 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.604279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.605832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.606139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.606436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.612289 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.613108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.613404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.613679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.613950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.614240 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.614514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.614790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.615061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.615169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 17:06:27.615354 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.615449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.615637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.615718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.615914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.615993 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.616179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.616262 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.616440 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.616521 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.616729 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.616999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.617285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.617653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.617928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.618202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.618481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.618755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 17:06:27.655904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555db1b439c0 pid: 80072 (default app) May 13 17:06:27.657295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555db1b439c0 pid: 80073 (default app) May 13 17:06:27.659257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae692701-7f24-431b-8455-2f8fb929c591 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:27.660080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae692701-7f24-431b-8455-2f8fb929c591 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:27.660371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae692701-7f24-431b-8455-2f8fb929c591 None None] PATH_INFO: `/v3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:27.664636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Fri May 13 17:06:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:36.438681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9281ec9-3323-4624-8c43-8247bf564aa6 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:36.439275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9281ec9-3323-4624-8c43-8247bf564aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:36.439275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9281ec9-3323-4624-8c43-8247bf564aa6 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:36.443676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:06:36.449022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2833-8602-4244-8cba-2725c24a3481 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:36.449407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2833-8602-4244-8cba-2725c24a3481 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:36.449575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2833-8602-4244-8cba-2725c24a3481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:36.480716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG oslo_db.sqlalchemy.engines [None req-715c2833-8602-4244-8cba-2725c24a3481 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:06:36.662615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG passlib.handlers.bcrypt [None req-715c2833-8602-4244-8cba-2725c24a3481 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80072) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 13 17:06:36.663032 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG passlib.handlers.bcrypt [None req-715c2833-8602-4244-8cba-2725c24a3481 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80072) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 13 17:06:36.717863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-715c2833-8602-4244-8cba-2725c24a3481 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:36.719436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-715c2833-8602-4244-8cba-2725c24a3481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:36.840849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 13 17:06:37.025388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9281ec9-3323-4624-8c43-8247bf564aa6 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:37.059188 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG oslo_db.sqlalchemy.engines [None req-c9281ec9-3323-4624-8c43-8247bf564aa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:06:37.188248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9281ec9-3323-4624-8c43-8247bf564aa6 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:37.192574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da436f88-1b67-4f70-af54-971e9a8bcc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:37.193237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436f88-1b67-4f70-af54-971e9a8bcc12 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:37.193636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436f88-1b67-4f70-af54-971e9a8bcc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:37.193797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436f88-1b67-4f70-af54-971e9a8bcc12 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:37.203356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da436f88-1b67-4f70-af54-971e9a8bcc12 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:37.267817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: WARNING keystone.common.rbac_enforcer.enforcer [None req-da436f88-1b67-4f70-af54-971e9a8bcc12 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 13 17:06:37.267817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da436f88-1b67-4f70-af54-971e9a8bcc12 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:37.267817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Fri May 13 17:06:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 17:06:37.273257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c2833-8602-4244-8cba-2725c24a3481 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:37.287251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c2833-8602-4244-8cba-2725c24a3481 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:37.291639 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615c371-ae06-46cb-b528-2db59b4c0bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:37.292759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615c371-ae06-46cb-b528-2db59b4c0bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:37.293047 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615c371-ae06-46cb-b528-2db59b4c0bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:37.293324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615c371-ae06-46cb-b528-2db59b4c0bb3 admin admin] PATH_INFO: `/v3/projects/6e1067556b2a41588af4e1e6fd0de9f1` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:37.294829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615c371-ae06-46cb-b528-2db59b4c0bb3 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e1067556b2a41588af4e1e6fd0de9f1)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:37.346368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3615c371-ae06-46cb-b528-2db59b4c0bb3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 13 17:06:37.346715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615c371-ae06-46cb-b528-2db59b4c0bb3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:37.351410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Fri May 13 17:06:37 2022] GET /identity/v3/projects/6e1067556b2a41588af4e1e6fd0de9f1 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:06:39.534423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71fa3d-55c3-4a04-ae32-da67021fb6af None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:39.534976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71fa3d-55c3-4a04-ae32-da67021fb6af None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:39.534976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71fa3d-55c3-4a04-ae32-da67021fb6af None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:39.539196 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:39.544527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e0236-ff9a-4888-9038-df4550f0909a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:39.544904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e0236-ff9a-4888-9038-df4550f0909a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:39.545123 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e0236-ff9a-4888-9038-df4550f0909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:39.565294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b98e0236-ff9a-4888-9038-df4550f0909a None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:39.567417 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b98e0236-ff9a-4888-9038-df4550f0909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:39.575522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 13 17:06:39.597515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71fa3d-55c3-4a04-ae32-da67021fb6af None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:39.609247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71fa3d-55c3-4a04-ae32-da67021fb6af None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:39.614003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976efa39-bb60-4c48-903b-2f5a89a6dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:39.614627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976efa39-bb60-4c48-903b-2f5a89a6dbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:39.614915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976efa39-bb60-4c48-903b-2f5a89a6dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:39.615231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976efa39-bb60-4c48-903b-2f5a89a6dbf2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:39.622738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976efa39-bb60-4c48-903b-2f5a89a6dbf2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:39.624577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976efa39-bb60-4c48-903b-2f5a89a6dbf2 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:39.633755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Fri May 13 17:06:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 17:06:39.638769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e0236-ff9a-4888-9038-df4550f0909a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:39.647426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e0236-ff9a-4888-9038-df4550f0909a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:39.651754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08f0b7-bb23-4c8d-b146-dbdd9f01c661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:39.652599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08f0b7-bb23-4c8d-b146-dbdd9f01c661 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:39.652884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08f0b7-bb23-4c8d-b146-dbdd9f01c661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:39.653161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08f0b7-bb23-4c8d-b146-dbdd9f01c661 admin admin] PATH_INFO: `/v3/users/3163ceb80e1143e28503836c92928e92` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:39.654530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08f0b7-bb23-4c8d-b146-dbdd9f01c661 admin admin] RBAC: Authorizing `identity:get_user(user_id=3163ceb80e1143e28503836c92928e92)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:39.656393 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08f0b7-bb23-4c8d-b146-dbdd9f01c661 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:39.657936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Fri May 13 17:06:39 2022] GET /identity/v3/users/3163ceb80e1143e28503836c92928e92 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:41.892494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366787e1-7d9e-424f-aa07-2248b2eb76f1 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:41.893040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366787e1-7d9e-424f-aa07-2248b2eb76f1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:41.893040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366787e1-7d9e-424f-aa07-2248b2eb76f1 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:41.894433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:41.899514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0c4cb-225e-48e6-806d-c78d71416488 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:41.899950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0c4cb-225e-48e6-806d-c78d71416488 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:41.900202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0c4cb-225e-48e6-806d-c78d71416488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:41.945021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a877ee6-32cb-4dad-a06c-04caa736f9a7 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:41.945302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a877ee6-32cb-4dad-a06c-04caa736f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:41.945575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a877ee6-32cb-4dad-a06c-04caa736f9a7 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:41.946938 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:06:41.953247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3159b-d424-4619-b9b3-9145ee03820d None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:41.953535 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3159b-d424-4619-b9b3-9145ee03820d None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:41.953813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3159b-d424-4619-b9b3-9145ee03820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:41.996132 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG passlib.handlers.bcrypt [None req-11e3159b-d424-4619-b9b3-9145ee03820d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80073) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 13 17:06:41.996554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG passlib.handlers.bcrypt [None req-11e3159b-d424-4619-b9b3-9145ee03820d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80073) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 13 17:06:42.035120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-cef0c4cb-225e-48e6-806d-c78d71416488 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:42.036364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-cef0c4cb-225e-48e6-806d-c78d71416488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:42.043867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-11e3159b-d424-4619-b9b3-9145ee03820d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:42.045432 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-11e3159b-d424-4619-b9b3-9145ee03820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:42.113860 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:06:42.137064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0c4cb-225e-48e6-806d-c78d71416488 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:42.141350 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:06:42.163623 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3159b-d424-4619-b9b3-9145ee03820d None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:42.235447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0c4cb-225e-48e6-806d-c78d71416488 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:42.259239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3159b-d424-4619-b9b3-9145ee03820d None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:42.267739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc8e20-345b-44f8-adb6-81683037e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:42.268532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc8e20-345b-44f8-adb6-81683037e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:42.268821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc8e20-345b-44f8-adb6-81683037e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:42.269663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc8e20-345b-44f8-adb6-81683037e7d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:42.280426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc8e20-345b-44f8-adb6-81683037e7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:06:42.291669 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3883f0e-aeb1-468f-9cb2-f4e7258deb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d9fc8e20-345b-44f8-adb6-81683037e7d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:06:42.292170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:06:42.293152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:06:42.294052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:06:42.294694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3883f0e-aeb1-468f-9cb2-f4e7258deb58 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:42.294694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3883f0e-aeb1-468f-9cb2-f4e7258deb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:42.294694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3883f0e-aeb1-468f-9cb2-f4e7258deb58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:42.294877 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:06:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:06:42.299249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc8e20-345b-44f8-adb6-81683037e7d2 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:42.358633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3883f0e-aeb1-468f-9cb2-f4e7258deb58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:42.360204 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3883f0e-aeb1-468f-9cb2-f4e7258deb58 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:42.391816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc8e20-345b-44f8-adb6-81683037e7d2 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:42.424230 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c100c89-c88e-4f77-9c84-8e753b905e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:42.424828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c100c89-c88e-4f77-9c84-8e753b905e83 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:42.425133 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c100c89-c88e-4f77-9c84-8e753b905e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:42.425413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c100c89-c88e-4f77-9c84-8e753b905e83 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:42.426157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c100c89-c88e-4f77-9c84-8e753b905e83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:42.426465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c100c89-c88e-4f77-9c84-8e753b905e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:42.427904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c100c89-c88e-4f77-9c84-8e753b905e83 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:42.439405 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:06:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:06:42.444566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c100c89-c88e-4f77-9c84-8e753b905e83 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:42.451305 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 17:06:42.457104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3883f0e-aeb1-468f-9cb2-f4e7258deb58 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:42.538568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c100c89-c88e-4f77-9c84-8e753b905e83 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:42.576456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10050fc-b8ea-4395-a314-87e203cb031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:42.577361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10050fc-b8ea-4395-a314-87e203cb031e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:42.577632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10050fc-b8ea-4395-a314-87e203cb031e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:42.577903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10050fc-b8ea-4395-a314-87e203cb031e None admin] PATH_INFO: `/v3/users/3163ceb80e1143e28503836c92928e92` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:42.579208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10050fc-b8ea-4395-a314-87e203cb031e None admin] RBAC: Authorizing `identity:get_user(user_id=3163ceb80e1143e28503836c92928e92)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:42.580742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10050fc-b8ea-4395-a314-87e203cb031e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:42.582691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:06:42 2022] GET /identity/v3/users/3163ceb80e1143e28503836c92928e92 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:06:42.588034 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10050fc-b8ea-4395-a314-87e203cb031e None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:42.657758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3883f0e-aeb1-468f-9cb2-f4e7258deb58 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:42.684822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10050fc-b8ea-4395-a314-87e203cb031e None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:42.690482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6c3f1-1ad8-4982-a298-a1e30096e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:42.691315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6c3f1-1ad8-4982-a298-a1e30096e0ca None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:42.691612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6c3f1-1ad8-4982-a298-a1e30096e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:42.691887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6c3f1-1ad8-4982-a298-a1e30096e0ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:42.710160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6c3f1-1ad8-4982-a298-a1e30096e0ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:42.711671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6c3f1-1ad8-4982-a298-a1e30096e0ca None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:42.716421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853cdba-9517-4078-8a1b-ccb0ac414a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:42.717206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853cdba-9517-4078-8a1b-ccb0ac414a6d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:42.717485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853cdba-9517-4078-8a1b-ccb0ac414a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:42.717751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853cdba-9517-4078-8a1b-ccb0ac414a6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:42.718911 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853cdba-9517-4078-8a1b-ccb0ac414a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:42.720375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853cdba-9517-4078-8a1b-ccb0ac414a6d None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:42.722483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:06:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:06:42.728079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853cdba-9517-4078-8a1b-ccb0ac414a6d None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-ade6c3f1-1ad8-4982-a298-a1e30096e0ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:06:42.732449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:06:42.733313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:06:42.734709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:06:42.734709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:06:42.734709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:06:42.734709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:06:42.734709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:06:42.739873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6c3f1-1ad8-4982-a298-a1e30096e0ca None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:42.821734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853cdba-9517-4078-8a1b-ccb0ac414a6d None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:42.835197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6c3f1-1ad8-4982-a298-a1e30096e0ca None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:42.854214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11876e68-651e-470d-ad32-4351c9abddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:42.854868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876e68-651e-470d-ad32-4351c9abddd2 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:42.855172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876e68-651e-470d-ad32-4351c9abddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:42.855461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876e68-651e-470d-ad32-4351c9abddd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:42.856295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876e68-651e-470d-ad32-4351c9abddd2 None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.domain.id=default, user.id=3163ceb80e1143e28503836c92928e92) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:42.856606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876e68-651e-470d-ad32-4351c9abddd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:42.858085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876e68-651e-470d-ad32-4351c9abddd2 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:42.865247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1322 bytes} [Fri May 13 17:06:42 2022] GET /identity/v3/role_assignments?user.id=3163ceb80e1143e28503836c92928e92&scope.domain.id=default&role.id=2791519d9bad43318f086666b6e64a20 => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:06:42.868267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ff1ed-14ff-4f32-82ec-2c5631e9bb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:42.868940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff1ed-14ff-4f32-82ec-2c5631e9bb39 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:42.869230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff1ed-14ff-4f32-82ec-2c5631e9bb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:42.869511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff1ed-14ff-4f32-82ec-2c5631e9bb39 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:42.870259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ff1ed-14ff-4f32-82ec-2c5631e9bb39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:42.870570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ff1ed-14ff-4f32-82ec-2c5631e9bb39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:42.872048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ff1ed-14ff-4f32-82ec-2c5631e9bb39 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:42.891557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:06:45.434390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300c8d-0f0b-4cfb-8deb-564c55605d65 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:45.434919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300c8d-0f0b-4cfb-8deb-564c55605d65 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:45.434919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300c8d-0f0b-4cfb-8deb-564c55605d65 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:45.436668 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:45.449455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1034d-9525-4e13-ba3b-f73365b2a87b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:45.449949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1034d-9525-4e13-ba3b-f73365b2a87b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:45.450048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1034d-9525-4e13-ba3b-f73365b2a87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:45.467464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-2ac1034d-9525-4e13-ba3b-f73365b2a87b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:45.468685 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2ac1034d-9525-4e13-ba3b-f73365b2a87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:45.549155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:06:45.588647 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300c8d-0f0b-4cfb-8deb-564c55605d65 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:45.727781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300c8d-0f0b-4cfb-8deb-564c55605d65 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:45.767715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd958e-d6b4-482b-8cbd-87ad004d8c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:45.768514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd958e-d6b4-482b-8cbd-87ad004d8c46 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:45.768827 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd958e-d6b4-482b-8cbd-87ad004d8c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:45.769108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd958e-d6b4-482b-8cbd-87ad004d8c46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:45.783907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd958e-d6b4-482b-8cbd-87ad004d8c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-25dd958e-d6b4-482b-8cbd-87ad004d8c46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:06:45.792402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:06:45.793246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:06:45.793994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 13/24] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:06:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:06:45.799468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1034d-9525-4e13-ba3b-f73365b2a87b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:45.849682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f554c82-3ccd-4b67-b9e9-38f7b73bee42 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:45.850011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f554c82-3ccd-4b67-b9e9-38f7b73bee42 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:45.850252 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f554c82-3ccd-4b67-b9e9-38f7b73bee42 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:45.852563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 14/25] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:06:45.857865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba3b4-4bf2-41c8-8d97-a3ac9b981d7d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:45.858153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba3b4-4bf2-41c8-8d97-a3ac9b981d7d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:45.858434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba3b4-4bf2-41c8-8d97-a3ac9b981d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:45.886283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-67bba3b4-4bf2-41c8-8d97-a3ac9b981d7d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:45.887539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-67bba3b4-4bf2-41c8-8d97-a3ac9b981d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:45.936648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1034d-9525-4e13-ba3b-f73365b2a87b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:45.980579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06be20f-5cda-4a36-9398-04e41d28fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:45.981536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be20f-5cda-4a36-9398-04e41d28fe50 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:45.981970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be20f-5cda-4a36-9398-04e41d28fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:45.982404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be20f-5cda-4a36-9398-04e41d28fe50 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:45.983401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be20f-5cda-4a36-9398-04e41d28fe50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:45.983869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be20f-5cda-4a36-9398-04e41d28fe50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:45.997200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be20f-5cda-4a36-9398-04e41d28fe50 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:46.006349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 12/26] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:06:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:46.011772 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06be20f-5cda-4a36-9398-04e41d28fe50 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:46.080916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 15/27] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 13 17:06:46.111150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bba3b4-4bf2-41c8-8d97-a3ac9b981d7d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:46.129056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06be20f-5cda-4a36-9398-04e41d28fe50 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:46.163872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a597636-f8ed-4557-a84e-efa280879a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:46.165036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a597636-f8ed-4557-a84e-efa280879a8d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:46.165480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a597636-f8ed-4557-a84e-efa280879a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:46.165926 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a597636-f8ed-4557-a84e-efa280879a8d None admin] PATH_INFO: `/v3/users/3163ceb80e1143e28503836c92928e92` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:46.167719 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a597636-f8ed-4557-a84e-efa280879a8d None admin] RBAC: Authorizing `identity:get_user(user_id=3163ceb80e1143e28503836c92928e92)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:46.169367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a597636-f8ed-4557-a84e-efa280879a8d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:46.171577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 13/28] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:06:46 2022] GET /identity/v3/users/3163ceb80e1143e28503836c92928e92 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:46.177094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a597636-f8ed-4557-a84e-efa280879a8d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:46.281636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a597636-f8ed-4557-a84e-efa280879a8d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:46.281820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bba3b4-4bf2-41c8-8d97-a3ac9b981d7d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:46.320152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc81e9-a16c-4063-aff6-a05ca37a0fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:46.321311 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc74073-4306-4d65-97ed-7b6c82b471f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:46.321447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc81e9-a16c-4063-aff6-a05ca37a0fdc None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:46.321662 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc81e9-a16c-4063-aff6-a05ca37a0fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:46.321952 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc81e9-a16c-4063-aff6-a05ca37a0fdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:46.322693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc74073-4306-4d65-97ed-7b6c82b471f1 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:46.323438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc74073-4306-4d65-97ed-7b6c82b471f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:46.323566 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc81e9-a16c-4063-aff6-a05ca37a0fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:46.324066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc74073-4306-4d65-97ed-7b6c82b471f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:46.324936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc81e9-a16c-4063-aff6-a05ca37a0fdc None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:46.325202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc74073-4306-4d65-97ed-7b6c82b471f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:46.326791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc74073-4306-4d65-97ed-7b6c82b471f1 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:46.326917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 14/29] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:06:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:06:46.328324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4ab52-47c0-459c-ac05-1c16a7c9fabb None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:46.328759 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4ab52-47c0-459c-ac05-1c16a7c9fabb None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:46.329198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4ab52-47c0-459c-ac05-1c16a7c9fabb None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:46.331099 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 15/30] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:46.332892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67cc70-5d65-428b-a9d4-1caf5740b0d1 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:46.333343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67cc70-5d65-428b-a9d4-1caf5740b0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:46.333897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67cc70-5d65-428b-a9d4-1caf5740b0d1 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:46.335704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 16/31] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:46.336979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd3a46-ad2c-4c86-bc10-758389d8da39 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:46.337431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd3a46-ad2c-4c86-bc10-758389d8da39 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:46.337858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd3a46-ad2c-4c86-bc10-758389d8da39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:46.355050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-cdbd3a46-ad2c-4c86-bc10-758389d8da39 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:46.356506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-cdbd3a46-ad2c-4c86-bc10-758389d8da39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:46.424583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 17/32] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:06:46.426290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd3a46-ad2c-4c86-bc10-758389d8da39 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:46.530334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd3a46-ad2c-4c86-bc10-758389d8da39 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:46.539963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 16/33] 10.222.0.64 () {60 vars in 1131 bytes} [Fri May 13 17:06:46 2022] POST /identity/v3/roles => generated 219 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:06:46.542974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813ac13-e81c-48bc-8556-157d84017247 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:46.543662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813ac13-e81c-48bc-8556-157d84017247 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:46.543992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813ac13-e81c-48bc-8556-157d84017247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:46.568660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6874b38-70de-4ad4-a2ca-3b9131bdf437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:46.569862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6874b38-70de-4ad4-a2ca-3b9131bdf437 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:46.570364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6874b38-70de-4ad4-a2ca-3b9131bdf437 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:46.570867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6874b38-70de-4ad4-a2ca-3b9131bdf437 None admin] PATH_INFO: `/v3/domains/default/users/3163ceb80e1143e28503836c92928e92/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:46.573463 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6874b38-70de-4ad4-a2ca-3b9131bdf437 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3163ceb80e1143e28503836c92928e92, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:46.575205 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6874b38-70de-4ad4-a2ca-3b9131bdf437 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:46.585209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d813ac13-e81c-48bc-8556-157d84017247 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:46.586794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d813ac13-e81c-48bc-8556-157d84017247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:46.663484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 17/34] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:06:46.664555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813ac13-e81c-48bc-8556-157d84017247 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:46.775538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813ac13-e81c-48bc-8556-157d84017247 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:46.895268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac354f6a-0534-4996-828f-b157ca218104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:46.895268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354f6a-0534-4996-828f-b157ca218104 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:46.895268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354f6a-0534-4996-828f-b157ca218104 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:46.895268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354f6a-0534-4996-828f-b157ca218104 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:46.895677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac354f6a-0534-4996-828f-b157ca218104 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:46.895677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac354f6a-0534-4996-828f-b157ca218104 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:46.895817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 18/35] 10.222.0.64 () {58 vars in 1361 bytes} [Fri May 13 17:06:46 2022] PUT /identity/v3/domains/default/users/3163ceb80e1143e28503836c92928e92/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:06:46.895817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04ea8-4c62-4dda-ba42-c4d554fe115f None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:46.895817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04ea8-4c62-4dda-ba42-c4d554fe115f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:46.895817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04ea8-4c62-4dda-ba42-c4d554fe115f None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:46.895817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:46.895817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04ea8-4c62-4dda-ba42-c4d554fe115f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:46.928326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1131 bytes} [Fri May 13 17:06:46 2022] POST /identity/v3/roles => generated 225 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:06:46.930029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4e89a-5c43-4a49-a6a3-ef13247dfbe5 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:46.930728 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4e89a-5c43-4a49-a6a3-ef13247dfbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:46.931583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4e89a-5c43-4a49-a6a3-ef13247dfbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:46.964893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2de4e89a-5c43-4a49-a6a3-ef13247dfbe5 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:46.966698 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2de4e89a-5c43-4a49-a6a3-ef13247dfbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:47.021979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04ea8-4c62-4dda-ba42-c4d554fe115f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:47.068971 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73337e6f-5ced-4c8d-8d31-8ea16be35b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:47.069927 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73337e6f-5ced-4c8d-8d31-8ea16be35b82 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:47.070218 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73337e6f-5ced-4c8d-8d31-8ea16be35b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:47.070506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73337e6f-5ced-4c8d-8d31-8ea16be35b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:47.083302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73337e6f-5ced-4c8d-8d31-8ea16be35b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:47.084988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73337e6f-5ced-4c8d-8d31-8ea16be35b82 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:47.085265 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 19/38] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-73337e6f-5ced-4c8d-8d31-8ea16be35b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:06:47.105850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:06:47.106763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:06:47.107642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:06:47.107642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:06:47.107642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:06:47.107642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:06:47.107642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 20/39] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:06:47.111598 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4e89a-5c43-4a49-a6a3-ef13247dfbe5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:47.113708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73337e6f-5ced-4c8d-8d31-8ea16be35b82 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:47.219027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73337e6f-5ced-4c8d-8d31-8ea16be35b82 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:47.226577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4e89a-5c43-4a49-a6a3-ef13247dfbe5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:47.256327 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8c245-a7a3-4918-ad8c-af237d0c079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:47.257003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8c245-a7a3-4918-ad8c-af237d0c079a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:47.257294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8c245-a7a3-4918-ad8c-af237d0c079a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:47.257584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8c245-a7a3-4918-ad8c-af237d0c079a None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:47.258320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8c245-a7a3-4918-ad8c-af237d0c079a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:47.258629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8c245-a7a3-4918-ad8c-af237d0c079a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:47.260082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8c245-a7a3-4918-ad8c-af237d0c079a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:47.265127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a7496-7186-483d-b715-0af67484a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:47.265812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7496-7186-483d-b715-0af67484a1e5 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:47.266096 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7496-7186-483d-b715-0af67484a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:47.266378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7496-7186-483d-b715-0af67484a1e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:47.267159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a7496-7186-483d-b715-0af67484a1e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:47.268661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a7496-7186-483d-b715-0af67484a1e5 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:47.272496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 21/40] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:47.278081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8c245-a7a3-4918-ad8c-af237d0c079a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:47.359033 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1131 bytes} [Fri May 13 17:06:47 2022] POST /identity/v3/roles => generated 223 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:06:47.396090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8c245-a7a3-4918-ad8c-af237d0c079a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:47.432684 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6025b8-6abc-4b67-a875-3dc937284146 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:47.433326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6025b8-6abc-4b67-a875-3dc937284146 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:47.433854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6025b8-6abc-4b67-a875-3dc937284146 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:47.435595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 21/42] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:06:47.441575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54416782-6445-464f-ad07-f26dd97bab84 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:47.442244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54416782-6445-464f-ad07-f26dd97bab84 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:47.442808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54416782-6445-464f-ad07-f26dd97bab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:47.445159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f85510-743b-4e9e-b880-2c19c45c74ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:47.445849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f85510-743b-4e9e-b880-2c19c45c74ef None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:47.446141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f85510-743b-4e9e-b880-2c19c45c74ef None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:47.446426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f85510-743b-4e9e-b880-2c19c45c74ef None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:47.447184 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f85510-743b-4e9e-b880-2c19c45c74ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:47.449273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f85510-743b-4e9e-b880-2c19c45c74ef None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:47.462838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-54416782-6445-464f-ad07-f26dd97bab84 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:47.464483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-54416782-6445-464f-ad07-f26dd97bab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:47.540387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 22/43] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:06:47.543525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 22/44] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:06:47 2022] POST /identity/v3/projects => generated 301 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:06:47.563991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54416782-6445-464f-ad07-f26dd97bab84 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:47.672677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54416782-6445-464f-ad07-f26dd97bab84 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:47.708217 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985c990-1107-4aae-9554-1777f98bf0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:47.709036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c990-1107-4aae-9554-1777f98bf0eb None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:47.709322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c990-1107-4aae-9554-1777f98bf0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:47.709599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c990-1107-4aae-9554-1777f98bf0eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:47.710842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c990-1107-4aae-9554-1777f98bf0eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:47.712399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c990-1107-4aae-9554-1777f98bf0eb None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:47.714290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 23/45] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:06:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:47.719890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f85510-743b-4e9e-b880-2c19c45c74ef None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:47.822576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f85510-743b-4e9e-b880-2c19c45c74ef None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:47.854890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7736e-35ba-466f-baf4-48728cc88702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:47.855579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7736e-35ba-466f-baf4-48728cc88702 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:47.855868 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7736e-35ba-466f-baf4-48728cc88702 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:47.856147 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7736e-35ba-466f-baf4-48728cc88702 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:47.856868 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7736e-35ba-466f-baf4-48728cc88702 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:47.858341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7736e-35ba-466f-baf4-48728cc88702 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:47.936272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:06:47 2022] POST /identity/v3/projects => generated 312 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:06:49.191798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b8daa-1f5f-4ae9-bcc9-8c456b890ebd None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:49.192408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b8daa-1f5f-4ae9-bcc9-8c456b890ebd None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:49.192408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b8daa-1f5f-4ae9-bcc9-8c456b890ebd None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:49.193756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 24/47] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:49.199334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450ebad-ff5c-450b-aaec-acb749b937a7 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:49.199715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450ebad-ff5c-450b-aaec-acb749b937a7 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:49.200010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450ebad-ff5c-450b-aaec-acb749b937a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:49.217120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e450ebad-ff5c-450b-aaec-acb749b937a7 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:49.218629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e450ebad-ff5c-450b-aaec-acb749b937a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:49.281537 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 24/48] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:06:49.304205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b8daa-1f5f-4ae9-bcc9-8c456b890ebd None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:49.402656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b8daa-1f5f-4ae9-bcc9-8c456b890ebd None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:49.436831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff508b-f2f1-4539-aaa2-fac54e821b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:49.437622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff508b-f2f1-4539-aaa2-fac54e821b9b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:49.437906 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff508b-f2f1-4539-aaa2-fac54e821b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:49.438185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff508b-f2f1-4539-aaa2-fac54e821b9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:49.448539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff508b-f2f1-4539-aaa2-fac54e821b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-2aff508b-f2f1-4539-aaa2-fac54e821b9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:06:49.456299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:06:49.457203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:06:49.458170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 25/49] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:06:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:06:49.463195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450ebad-ff5c-450b-aaec-acb749b937a7 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:49.556355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450ebad-ff5c-450b-aaec-acb749b937a7 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:49.588060 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28a6e0-cb01-410a-b43a-3107ba0f1978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:49.588735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28a6e0-cb01-410a-b43a-3107ba0f1978 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:49.589022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28a6e0-cb01-410a-b43a-3107ba0f1978 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:49.589301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28a6e0-cb01-410a-b43a-3107ba0f1978 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:49.590052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28a6e0-cb01-410a-b43a-3107ba0f1978 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:49.590363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28a6e0-cb01-410a-b43a-3107ba0f1978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:49.591788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28a6e0-cb01-410a-b43a-3107ba0f1978 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:49.600132 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 25/50] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:06:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:49.607770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff508b-f2f1-4539-aaa2-fac54e821b9b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:49.708550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff508b-f2f1-4539-aaa2-fac54e821b9b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:49.740924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25610382-5f96-48e5-b8a3-31fd2ce981b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:49.741802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25610382-5f96-48e5-b8a3-31fd2ce981b4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:49.742088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25610382-5f96-48e5-b8a3-31fd2ce981b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:49.742368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25610382-5f96-48e5-b8a3-31fd2ce981b4 None admin] PATH_INFO: `/v3/users/3163ceb80e1143e28503836c92928e92` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:49.743588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25610382-5f96-48e5-b8a3-31fd2ce981b4 None admin] RBAC: Authorizing `identity:get_user(user_id=3163ceb80e1143e28503836c92928e92)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:49.745072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25610382-5f96-48e5-b8a3-31fd2ce981b4 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:49.746710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 26/51] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:06:49 2022] GET /identity/v3/users/3163ceb80e1143e28503836c92928e92 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:49.752056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28a6e0-cb01-410a-b43a-3107ba0f1978 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:49.848024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28a6e0-cb01-410a-b43a-3107ba0f1978 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:49.880516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb9c0c-b7ce-4cec-b2f7-a030ef3e7689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:49.881308 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9c0c-b7ce-4cec-b2f7-a030ef3e7689 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:49.881596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9c0c-b7ce-4cec-b2f7-a030ef3e7689 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:49.881878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9c0c-b7ce-4cec-b2f7-a030ef3e7689 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:49.883066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb9c0c-b7ce-4cec-b2f7-a030ef3e7689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:49.884573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb9c0c-b7ce-4cec-b2f7-a030ef3e7689 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:49.886207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 26/52] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:06:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:49.891955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25610382-5f96-48e5-b8a3-31fd2ce981b4 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:49.991343 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25610382-5f96-48e5-b8a3-31fd2ce981b4 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:50.023721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823d7d9-d2e1-4955-a5f8-e352c7643ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:50.024367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823d7d9-d2e1-4955-a5f8-e352c7643ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:50.024657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823d7d9-d2e1-4955-a5f8-e352c7643ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:50.024936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823d7d9-d2e1-4955-a5f8-e352c7643ad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:50.025763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823d7d9-d2e1-4955-a5f8-e352c7643ad9 None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.domain.id=default, user.id=3163ceb80e1143e28503836c92928e92) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:50.026082 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823d7d9-d2e1-4955-a5f8-e352c7643ad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:50.027612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823d7d9-d2e1-4955-a5f8-e352c7643ad9 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:50.033328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 27/53] 10.222.0.64 () {56 vars in 1322 bytes} [Fri May 13 17:06:49 2022] GET /identity/v3/role_assignments?user.id=3163ceb80e1143e28503836c92928e92&scope.domain.id=default&role.id=2791519d9bad43318f086666b6e64a20 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:06:50.140045 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e2a98-3829-427e-b49b-3f594fe9443a None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:50.141822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e2a98-3829-427e-b49b-3f594fe9443a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:50.142349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e2a98-3829-427e-b49b-3f594fe9443a None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:50.143840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 27/54] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:50.149877 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c8c29-8f73-4ef6-b5af-3a53c96ddfb4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:50.150166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c8c29-8f73-4ef6-b5af-3a53c96ddfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:50.151111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c8c29-8f73-4ef6-b5af-3a53c96ddfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:50.168401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0b3c8c29-8f73-4ef6-b5af-3a53c96ddfb4 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:50.169652 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0b3c8c29-8f73-4ef6-b5af-3a53c96ddfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:50.240055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 28/55] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:06:50.262764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e2a98-3829-427e-b49b-3f594fe9443a None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:50.359514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e2a98-3829-427e-b49b-3f594fe9443a None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:50.390709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a5ab-5296-4a59-96bc-b1bcea6f1345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:50.391474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a5ab-5296-4a59-96bc-b1bcea6f1345 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:50.391762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a5ab-5296-4a59-96bc-b1bcea6f1345 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:50.392042 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a5ab-5296-4a59-96bc-b1bcea6f1345 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:50.393217 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a5ab-5296-4a59-96bc-b1bcea6f1345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:50.394717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a5ab-5296-4a59-96bc-b1bcea6f1345 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:50.396352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 28/56] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:06:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:50.401917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c8c29-8f73-4ef6-b5af-3a53c96ddfb4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:50.494430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c8c29-8f73-4ef6-b5af-3a53c96ddfb4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:50.525844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c933d-839c-4e7f-8618-971cf734b87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:50.526501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c933d-839c-4e7f-8618-971cf734b87b None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:50.526785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c933d-839c-4e7f-8618-971cf734b87b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:50.527061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c933d-839c-4e7f-8618-971cf734b87b None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:50.527797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c933d-839c-4e7f-8618-971cf734b87b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:50.529275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c933d-839c-4e7f-8618-971cf734b87b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:50.599693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 29/57] 10.222.0.64 () {60 vars in 1140 bytes} [Fri May 13 17:06:50 2022] POST /identity/v3/projects => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:06:52.829826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d367e84-01dc-4993-bd36-36e5e6e0d4a8 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:52.830340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d367e84-01dc-4993-bd36-36e5e6e0d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:52.830459 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d367e84-01dc-4993-bd36-36e5e6e0d4a8 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:52.832319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 29/58] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:52.837454 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a626d-8383-4434-9329-2cab21873d27 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:52.837863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a626d-8383-4434-9329-2cab21873d27 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:52.838016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a626d-8383-4434-9329-2cab21873d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:52.854802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-152a626d-8383-4434-9329-2cab21873d27 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:52.856019 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-152a626d-8383-4434-9329-2cab21873d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:52.918280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 30/59] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:06:52.942784 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d367e84-01dc-4993-bd36-36e5e6e0d4a8 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:53.039514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d367e84-01dc-4993-bd36-36e5e6e0d4a8 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:53.071485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7e0ec-f654-4253-a638-c3d4989cf486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:53.072275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e0ec-f654-4253-a638-c3d4989cf486 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:53.072563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e0ec-f654-4253-a638-c3d4989cf486 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:53.072844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e0ec-f654-4253-a638-c3d4989cf486 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:53.074258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7e0ec-f654-4253-a638-c3d4989cf486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:53.075807 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7e0ec-f654-4253-a638-c3d4989cf486 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:53.077416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 30/60] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:06:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:53.082964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a626d-8383-4434-9329-2cab21873d27 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:53.176856 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a626d-8383-4434-9329-2cab21873d27 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:53.208806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962a235-7dbf-4db7-a521-872a973bcf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:53.209467 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a235-7dbf-4db7-a521-872a973bcf04 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:53.209754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a235-7dbf-4db7-a521-872a973bcf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:53.210033 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962a235-7dbf-4db7-a521-872a973bcf04 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:53.210748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962a235-7dbf-4db7-a521-872a973bcf04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:53.212256 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962a235-7dbf-4db7-a521-872a973bcf04 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:53.315818 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 31/61] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:06:53 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:06:56.934574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31484112-857a-4592-9d57-f1218fa1383b None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:56.935653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31484112-857a-4592-9d57-f1218fa1383b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:56.936147 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31484112-857a-4592-9d57-f1218fa1383b None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:56.937742 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 31/62] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:56.943057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96de86-823c-4d50-a574-2fd18a1c84e3 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:56.943886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96de86-823c-4d50-a574-2fd18a1c84e3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:56.944365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96de86-823c-4d50-a574-2fd18a1c84e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:56.965064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-dd96de86-823c-4d50-a574-2fd18a1c84e3 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:56.966803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dd96de86-823c-4d50-a574-2fd18a1c84e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:57.011074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76859d48-7417-48df-abce-b97e60bcd778 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.011738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76859d48-7417-48df-abce-b97e60bcd778 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.012246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76859d48-7417-48df-abce-b97e60bcd778 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.014215 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 32/63] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:57.020912 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dda99b-c173-45a4-961c-ca7e89c9eeef None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.021555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dda99b-c173-45a4-961c-ca7e89c9eeef None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.022041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dda99b-c173-45a4-961c-ca7e89c9eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.047166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 32/64] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:06:57.048524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dbdcf-e38b-4d8a-96e4-57865b4d03e4 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.048818 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dbdcf-e38b-4d8a-96e4-57865b4d03e4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.049100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dbdcf-e38b-4d8a-96e4-57865b4d03e4 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.050696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 33/65] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:57.051554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-14dda99b-c173-45a4-961c-ca7e89c9eeef None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:57.053053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-14dda99b-c173-45a4-961c-ca7e89c9eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:57.068007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbd96-ebce-480d-952e-347aa013ef73 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.068298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbd96-ebce-480d-952e-347aa013ef73 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.068584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbd96-ebce-480d-952e-347aa013ef73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.096179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5bedbd96-ebce-480d-952e-347aa013ef73 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:57.098414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5bedbd96-ebce-480d-952e-347aa013ef73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:57.126911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 33/66] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:06:57.128535 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dda99b-c173-45a4-961c-ca7e89c9eeef None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:57.180086 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 34/67] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:06:57.187205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedbd96-ebce-480d-952e-347aa013ef73 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:57.238745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dda99b-c173-45a4-961c-ca7e89c9eeef None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:57.275228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820c2bb-cb75-459f-8068-4b968ca6b1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:57.276030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c2bb-cb75-459f-8068-4b968ca6b1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.276317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c2bb-cb75-459f-8068-4b968ca6b1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.276593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c2bb-cb75-459f-8068-4b968ca6b1d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.288270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820c2bb-cb75-459f-8068-4b968ca6b1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:06:57.295954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedbd96-ebce-480d-952e-347aa013ef73 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-3820c2bb-cb75-459f-8068-4b968ca6b1d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:06:57.297136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:06:57.298004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:06:57.298760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 34/68] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:06:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:06:57.299919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb4eb-2a26-43b0-b41f-5c8e807e2577 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.300028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb4eb-2a26-43b0-b41f-5c8e807e2577 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.300255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb4eb-2a26-43b0-b41f-5c8e807e2577 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.303257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 35/69] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:57.303257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fb4eb-2a26-43b0-b41f-5c8e807e2577 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:57.328936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee00f0a-78e7-4402-a909-b505d35d7e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:57.329724 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee00f0a-78e7-4402-a909-b505d35d7e70 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.330006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee00f0a-78e7-4402-a909-b505d35d7e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.330292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee00f0a-78e7-4402-a909-b505d35d7e70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.341505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee00f0a-78e7-4402-a909-b505d35d7e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-7ee00f0a-78e7-4402-a909-b505d35d7e70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:06:57.349715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:06:57.350537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:06:57.351597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 35/70] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:06:57.352515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fadf8-9b93-497b-83bc-0d806866bd8f None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.352807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fadf8-9b93-497b-83bc-0d806866bd8f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.353087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fadf8-9b93-497b-83bc-0d806866bd8f None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.354341 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 36/71] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:06:57.355249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fadf8-9b93-497b-83bc-0d806866bd8f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:57.405914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fb4eb-2a26-43b0-b41f-5c8e807e2577 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:57.437473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7c761-cf06-42b0-a2bb-9370972f74ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:57.438211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c761-cf06-42b0-a2bb-9370972f74ae None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.438494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c761-cf06-42b0-a2bb-9370972f74ae None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.438770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c761-cf06-42b0-a2bb-9370972f74ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.449255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7c761-cf06-42b0-a2bb-9370972f74ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:06:57.452642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fadf8-9b93-497b-83bc-0d806866bd8f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-1de7c761-cf06-42b0-a2bb-9370972f74ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:06:57.457547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:06:57.458433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:06:57.459230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 36/72] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:06:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:06:57.460408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac180-1539-4645-9d12-82a6ea0b458b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.460730 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac180-1539-4645-9d12-82a6ea0b458b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.461006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac180-1539-4645-9d12-82a6ea0b458b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.476816 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-b9dac180-1539-4645-9d12-82a6ea0b458b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:57.477995 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b9dac180-1539-4645-9d12-82a6ea0b458b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:57.486080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da4008-1b88-4cbd-b016-5e85531776c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:57.486750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da4008-1b88-4cbd-b016-5e85531776c4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.487045 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da4008-1b88-4cbd-b016-5e85531776c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.488011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da4008-1b88-4cbd-b016-5e85531776c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.488789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da4008-1b88-4cbd-b016-5e85531776c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:57.489102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da4008-1b88-4cbd-b016-5e85531776c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:57.490518 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da4008-1b88-4cbd-b016-5e85531776c4 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:57.498848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 37/73] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:06:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:57.499680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da4008-1b88-4cbd-b016-5e85531776c4 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:57.540586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 37/74] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:06:57.541870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6601957-a577-46e0-ac6a-5728b4166407 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.542172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6601957-a577-46e0-ac6a-5728b4166407 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.542532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6601957-a577-46e0-ac6a-5728b4166407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.558150 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f6601957-a577-46e0-ac6a-5728b4166407 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:06:57.559357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f6601957-a577-46e0-ac6a-5728b4166407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:06:57.592918 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da4008-1b88-4cbd-b016-5e85531776c4 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:57.622594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 38/75] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:06:57.623456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6601957-a577-46e0-ac6a-5728b4166407 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:57.625015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c0d79-215b-4014-bdff-ced68ab35d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:57.625687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c0d79-215b-4014-bdff-ced68ab35d61 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.625972 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c0d79-215b-4014-bdff-ced68ab35d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.626243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c0d79-215b-4014-bdff-ced68ab35d61 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.626987 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c0d79-215b-4014-bdff-ced68ab35d61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:57.627328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c0d79-215b-4014-bdff-ced68ab35d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:57.629307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c0d79-215b-4014-bdff-ced68ab35d61 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:57.637334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 38/76] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:06:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:57.640308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c0d79-215b-4014-bdff-ced68ab35d61 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:57.716859 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6601957-a577-46e0-ac6a-5728b4166407 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:57.734294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c0d79-215b-4014-bdff-ced68ab35d61 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:57.749432 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89998f8e-9793-4753-8c07-76c23903d07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:57.750097 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89998f8e-9793-4753-8c07-76c23903d07f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.750386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89998f8e-9793-4753-8c07-76c23903d07f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.750670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89998f8e-9793-4753-8c07-76c23903d07f None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.751446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89998f8e-9793-4753-8c07-76c23903d07f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:57.751757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89998f8e-9793-4753-8c07-76c23903d07f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:57.753164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89998f8e-9793-4753-8c07-76c23903d07f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:57.760725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 39/77] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:06:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:57.761510 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89998f8e-9793-4753-8c07-76c23903d07f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:57.770763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7cfd-8a42-4aff-ab1b-25a98354605a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:57.771686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7cfd-8a42-4aff-ab1b-25a98354605a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.771971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7cfd-8a42-4aff-ab1b-25a98354605a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.772243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7cfd-8a42-4aff-ab1b-25a98354605a None admin] PATH_INFO: `/v3/users/90fb781936154a33addfe7c9d4af6617` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.785844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7cfd-8a42-4aff-ab1b-25a98354605a None admin] RBAC: Authorizing `identity:get_user(user_id=90fb781936154a33addfe7c9d4af6617)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:57.787362 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7cfd-8a42-4aff-ab1b-25a98354605a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:57.789017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 39/78] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:06:57 2022] GET /identity/v3/users/90fb781936154a33addfe7c9d4af6617 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:57.789783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7cfd-8a42-4aff-ab1b-25a98354605a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:57.856139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89998f8e-9793-4753-8c07-76c23903d07f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:57.884513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7cfd-8a42-4aff-ab1b-25a98354605a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:57.887873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca995-ea4f-44ab-a743-604afef7bf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:57.888666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca995-ea4f-44ab-a743-604afef7bf14 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.888953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca995-ea4f-44ab-a743-604afef7bf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.889233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ca995-ea4f-44ab-a743-604afef7bf14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.890413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ca995-ea4f-44ab-a743-604afef7bf14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:57.891927 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ca995-ea4f-44ab-a743-604afef7bf14 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:57.893579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 40/79] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:06:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:57.894347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca995-ea4f-44ab-a743-604afef7bf14 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:57.920711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd862b10-0e48-4f9d-b307-9b80312b9e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:57.921583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd862b10-0e48-4f9d-b307-9b80312b9e80 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:57.921864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd862b10-0e48-4f9d-b307-9b80312b9e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:57.922142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd862b10-0e48-4f9d-b307-9b80312b9e80 None admin] PATH_INFO: `/v3/users/3163ceb80e1143e28503836c92928e92` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:57.923348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd862b10-0e48-4f9d-b307-9b80312b9e80 None admin] RBAC: Authorizing `identity:get_user(user_id=3163ceb80e1143e28503836c92928e92)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:57.925387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd862b10-0e48-4f9d-b307-9b80312b9e80 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:57.927270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 40/80] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:06:57 2022] GET /identity/v3/users/3163ceb80e1143e28503836c92928e92 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:57.928044 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd862b10-0e48-4f9d-b307-9b80312b9e80 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:57.988938 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ca995-ea4f-44ab-a743-604afef7bf14 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:58.020822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f2bc6-0e10-42a7-bef6-054a01f9f23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:58.021616 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f2bc6-0e10-42a7-bef6-054a01f9f23f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:58.021903 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f2bc6-0e10-42a7-bef6-054a01f9f23f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:58.022182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f2bc6-0e10-42a7-bef6-054a01f9f23f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:58.022665 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd862b10-0e48-4f9d-b307-9b80312b9e80 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:58.031974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f2bc6-0e10-42a7-bef6-054a01f9f23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-2f4f2bc6-0e10-42a7-bef6-054a01f9f23f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:06:58.040247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:06:58.041093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:06:58.041845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 41/81] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:06:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:06:58.042458 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f2bc6-0e10-42a7-bef6-054a01f9f23f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:58.055964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e572a9-4a44-4ceb-b041-c50d2cea5267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:58.056840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e572a9-4a44-4ceb-b041-c50d2cea5267 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:58.057127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e572a9-4a44-4ceb-b041-c50d2cea5267 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:58.057400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e572a9-4a44-4ceb-b041-c50d2cea5267 None admin] PATH_INFO: `/v3/users/90fb781936154a33addfe7c9d4af6617` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:58.058586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e572a9-4a44-4ceb-b041-c50d2cea5267 None admin] RBAC: Authorizing `identity:get_user(user_id=90fb781936154a33addfe7c9d4af6617)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:58.060092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e572a9-4a44-4ceb-b041-c50d2cea5267 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:58.061870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 41/82] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:06:57 2022] GET /identity/v3/users/90fb781936154a33addfe7c9d4af6617 => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:58.062463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e572a9-4a44-4ceb-b041-c50d2cea5267 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:58.138872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f2bc6-0e10-42a7-bef6-054a01f9f23f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:58.158338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e572a9-4a44-4ceb-b041-c50d2cea5267 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:58.170857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083911e-0274-4c83-b8ca-4ef21e42f168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:58.171536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083911e-0274-4c83-b8ca-4ef21e42f168 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:58.171820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083911e-0274-4c83-b8ca-4ef21e42f168 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:58.172097 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083911e-0274-4c83-b8ca-4ef21e42f168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:58.191212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0d912-92ba-4996-bd61-2e66377b1226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:58.192308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0d912-92ba-4996-bd61-2e66377b1226 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:58.192747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0d912-92ba-4996-bd61-2e66377b1226 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:58.193259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0d912-92ba-4996-bd61-2e66377b1226 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:58.194588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0d912-92ba-4996-bd61-2e66377b1226 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:58.195946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0d912-92ba-4996-bd61-2e66377b1226 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:58.244042 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083911e-0274-4c83-b8ca-4ef21e42f168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:58.245442 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083911e-0274-4c83-b8ca-4ef21e42f168 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:58.298744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 42/83] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:06:58 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:06:58.299626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0d912-92ba-4996-bd61-2e66377b1226 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:58.348489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 42/84] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:06:58.348489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083911e-0274-4c83-b8ca-4ef21e42f168 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:58.420183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0d912-92ba-4996-bd61-2e66377b1226 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:58.448721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083911e-0274-4c83-b8ca-4ef21e42f168 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:58.455872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22410b8b-e2ba-4bee-aa81-a93ee955f7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:58.457107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410b8b-e2ba-4bee-aa81-a93ee955f7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:58.457392 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410b8b-e2ba-4bee-aa81-a93ee955f7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:58.457664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410b8b-e2ba-4bee-aa81-a93ee955f7e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:58.484495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1432096-1350-48ec-9baa-1ef42f6b575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:58.485179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1432096-1350-48ec-9baa-1ef42f6b575d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:58.485468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1432096-1350-48ec-9baa-1ef42f6b575d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:58.485750 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1432096-1350-48ec-9baa-1ef42f6b575d None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:58.486515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1432096-1350-48ec-9baa-1ef42f6b575d None admin] RBAC: Adding query filter params (name=member) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:58.486831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1432096-1350-48ec-9baa-1ef42f6b575d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:58.488392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1432096-1350-48ec-9baa-1ef42f6b575d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:58.496837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 43/85] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:58.497478 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1432096-1350-48ec-9baa-1ef42f6b575d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:58.528334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22410b8b-e2ba-4bee-aa81-a93ee955f7e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:58.529855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22410b8b-e2ba-4bee-aa81-a93ee955f7e6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:58.601350 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1432096-1350-48ec-9baa-1ef42f6b575d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:58.631273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 43/86] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:06:58.632228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22410b8b-e2ba-4bee-aa81-a93ee955f7e6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:58.635931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28226b02-c6f6-4133-89bf-147a5986d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:58.636457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28226b02-c6f6-4133-89bf-147a5986d36d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:58.636746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28226b02-c6f6-4133-89bf-147a5986d36d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:58.637028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28226b02-c6f6-4133-89bf-147a5986d36d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:58.708665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28226b02-c6f6-4133-89bf-147a5986d36d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:58.710243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28226b02-c6f6-4133-89bf-147a5986d36d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:58.732422 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22410b8b-e2ba-4bee-aa81-a93ee955f7e6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:58.767232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a1436-878d-4840-aa9b-ed99827a9846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:58.768036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1436-878d-4840-aa9b-ed99827a9846 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:58.768319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1436-878d-4840-aa9b-ed99827a9846 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:58.768631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1436-878d-4840-aa9b-ed99827a9846 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:58.769835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a1436-878d-4840-aa9b-ed99827a9846 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:58.771356 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a1436-878d-4840-aa9b-ed99827a9846 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:58.773077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 44/87] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:06:58 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:58.773863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a1436-878d-4840-aa9b-ed99827a9846 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:58.816639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 44/88] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:06:58.821985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28226b02-c6f6-4133-89bf-147a5986d36d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:58.873806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a1436-878d-4840-aa9b-ed99827a9846 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:58.908559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d261a8-6d46-4088-b7cb-af2462efd98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:58.909467 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d261a8-6d46-4088-b7cb-af2462efd98a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:58.909754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d261a8-6d46-4088-b7cb-af2462efd98a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:58.910033 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d261a8-6d46-4088-b7cb-af2462efd98a None admin] PATH_INFO: `/v3/users/90fb781936154a33addfe7c9d4af6617` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:58.911277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d261a8-6d46-4088-b7cb-af2462efd98a None admin] RBAC: Authorizing `identity:get_user(user_id=90fb781936154a33addfe7c9d4af6617)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:58.912761 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d261a8-6d46-4088-b7cb-af2462efd98a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:58.914413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 45/89] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:06:58 2022] GET /identity/v3/users/90fb781936154a33addfe7c9d4af6617 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:58.915240 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d261a8-6d46-4088-b7cb-af2462efd98a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:58.924423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28226b02-c6f6-4133-89bf-147a5986d36d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:58.960639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe34c0-1cdb-4daf-984b-c0e11f2bc2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:58.963241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe34c0-1cdb-4daf-984b-c0e11f2bc2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:58.963241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe34c0-1cdb-4daf-984b-c0e11f2bc2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:58.963241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe34c0-1cdb-4daf-984b-c0e11f2bc2d2 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:58.964168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe34c0-1cdb-4daf-984b-c0e11f2bc2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:58.965873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe34c0-1cdb-4daf-984b-c0e11f2bc2d2 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:58.968191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 45/90] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:06:58 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:58.969315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe34c0-1cdb-4daf-984b-c0e11f2bc2d2 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:59.016333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d261a8-6d46-4088-b7cb-af2462efd98a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:59.051215 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dec4bf-8be5-4139-8372-4aa9babfb8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:59.053045 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dec4bf-8be5-4139-8372-4aa9babfb8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:59.053159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dec4bf-8be5-4139-8372-4aa9babfb8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:59.053431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dec4bf-8be5-4139-8372-4aa9babfb8f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:59.054273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dec4bf-8be5-4139-8372-4aa9babfb8f3 None admin] RBAC: Adding query filter params (role.id=52bafac2651a4075879b7d97a4f9111e, scope.project.id=17128730ad3c43e194e508cc0fcd24cb, user.id=90fb781936154a33addfe7c9d4af6617) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:59.054589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dec4bf-8be5-4139-8372-4aa9babfb8f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:59.056094 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dec4bf-8be5-4139-8372-4aa9babfb8f3 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:59.061954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 46/91] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:06:58 2022] GET /identity/v3/role_assignments?user.id=90fb781936154a33addfe7c9d4af6617&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=52bafac2651a4075879b7d97a4f9111e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:59.063551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dec4bf-8be5-4139-8372-4aa9babfb8f3 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:59.093187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe34c0-1cdb-4daf-984b-c0e11f2bc2d2 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:59.154772 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fd655-f856-47b9-94f1-6d9ba7f823f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:59.156122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd655-f856-47b9-94f1-6d9ba7f823f1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:59.156613 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd655-f856-47b9-94f1-6d9ba7f823f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:59.157108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd655-f856-47b9-94f1-6d9ba7f823f1 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:59.158508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fd655-f856-47b9-94f1-6d9ba7f823f1 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:59.160851 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fd655-f856-47b9-94f1-6d9ba7f823f1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:59.162968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 46/92] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:06:58 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:59.165847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fd655-f856-47b9-94f1-6d9ba7f823f1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:59.185630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dec4bf-8be5-4139-8372-4aa9babfb8f3 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:59.236380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0d01-004d-44c3-a486-a5ba1be09459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:59.237029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0d01-004d-44c3-a486-a5ba1be09459 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:59.243294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0d01-004d-44c3-a486-a5ba1be09459 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:59.243294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0d01-004d-44c3-a486-a5ba1be09459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:59.353362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fd655-f856-47b9-94f1-6d9ba7f823f1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:59.366732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d0d01-004d-44c3-a486-a5ba1be09459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:59.368530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d0d01-004d-44c3-a486-a5ba1be09459 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:59.398649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68340ac8-de1a-46a7-92e1-4aa9b4baa6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:59.399468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68340ac8-de1a-46a7-92e1-4aa9b4baa6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:59.399873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68340ac8-de1a-46a7-92e1-4aa9b4baa6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:59.400296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68340ac8-de1a-46a7-92e1-4aa9b4baa6f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:59.401308 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68340ac8-de1a-46a7-92e1-4aa9b4baa6f9 None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=17128730ad3c43e194e508cc0fcd24cb, user.id=3163ceb80e1143e28503836c92928e92) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:59.401839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68340ac8-de1a-46a7-92e1-4aa9b4baa6f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:59.403355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68340ac8-de1a-46a7-92e1-4aa9b4baa6f9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:59.413809 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 47/93] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:06:59 2022] GET /identity/v3/role_assignments?user.id=3163ceb80e1143e28503836c92928e92&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=2791519d9bad43318f086666b6e64a20 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:59.415545 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68340ac8-de1a-46a7-92e1-4aa9b4baa6f9 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:59.476745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 47/94] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:06:59.484302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0d01-004d-44c3-a486-a5ba1be09459 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:06:59.643017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68340ac8-de1a-46a7-92e1-4aa9b4baa6f9 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:59.695354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f34971-338c-4540-a2c5-93dce1fc5032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:59.696195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f34971-338c-4540-a2c5-93dce1fc5032 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:59.696491 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f34971-338c-4540-a2c5-93dce1fc5032 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:59.696894 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f34971-338c-4540-a2c5-93dce1fc5032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:59.697755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f34971-338c-4540-a2c5-93dce1fc5032 None admin] RBAC: Adding query filter params (role.id=1efabb1110d64eebacd85d9016d7d286, scope.project.id=17128730ad3c43e194e508cc0fcd24cb, user.id=90fb781936154a33addfe7c9d4af6617) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:06:59.698331 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f34971-338c-4540-a2c5-93dce1fc5032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:59.700007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f34971-338c-4540-a2c5-93dce1fc5032 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:59.712325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 48/95] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:06:59 2022] GET /identity/v3/role_assignments?user.id=90fb781936154a33addfe7c9d4af6617&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=1efabb1110d64eebacd85d9016d7d286 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:59.739191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0d01-004d-44c3-a486-a5ba1be09459 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:06:59.801318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdf5ee-d92b-4c0c-b954-265f4a7b2f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:06:59.802590 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdf5ee-d92b-4c0c-b954-265f4a7b2f1d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:06:59.803092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdf5ee-d92b-4c0c-b954-265f4a7b2f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:06:59.803615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdf5ee-d92b-4c0c-b954-265f4a7b2f1d None admin] PATH_INFO: `/v3/projects/d2b0c1935ce64c42941dd272713e4a00` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:06:59.805040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdf5ee-d92b-4c0c-b954-265f4a7b2f1d None admin] RBAC: Authorizing `identity:get_project(project_id=d2b0c1935ce64c42941dd272713e4a00)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:06:59.806738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdf5ee-d92b-4c0c-b954-265f4a7b2f1d None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:06:59.808700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 48/96] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:06:59 2022] GET /identity/v3/projects/d2b0c1935ce64c42941dd272713e4a00 => generated 312 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:06:59.815288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f34971-338c-4540-a2c5-93dce1fc5032 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:00.010822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f34971-338c-4540-a2c5-93dce1fc5032 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:00.045448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef8fca-4f30-4ab1-9fbf-9f13f58e3652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:00.047030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef8fca-4f30-4ab1-9fbf-9f13f58e3652 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:00.047030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef8fca-4f30-4ab1-9fbf-9f13f58e3652 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:00.047030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef8fca-4f30-4ab1-9fbf-9f13f58e3652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:00.047557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef8fca-4f30-4ab1-9fbf-9f13f58e3652 None admin] RBAC: Adding query filter params (role.id=52bafac2651a4075879b7d97a4f9111e, scope.project.id=d2b0c1935ce64c42941dd272713e4a00, user.id=90fb781936154a33addfe7c9d4af6617) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:00.047906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef8fca-4f30-4ab1-9fbf-9f13f58e3652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:00.049378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef8fca-4f30-4ab1-9fbf-9f13f58e3652 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:00.055836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 49/97] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:06:59 2022] GET /identity/v3/role_assignments?user.id=90fb781936154a33addfe7c9d4af6617&scope.project.id=d2b0c1935ce64c42941dd272713e4a00&role.id=52bafac2651a4075879b7d97a4f9111e => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:01.034126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dec00-3283-45f2-b0e0-7fe9a0136f22 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:01.035159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dec00-3283-45f2-b0e0-7fe9a0136f22 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:01.035260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dec00-3283-45f2-b0e0-7fe9a0136f22 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:01.036621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 49/98] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:01.042546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dd52a-4159-4337-b194-74cee0040c7b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:01.043060 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dd52a-4159-4337-b194-74cee0040c7b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:01.043167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dd52a-4159-4337-b194-74cee0040c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:01.064673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-380dd52a-4159-4337-b194-74cee0040c7b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:01.065909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-380dd52a-4159-4337-b194-74cee0040c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:01.149806 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 50/99] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:01.179051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dec00-3283-45f2-b0e0-7fe9a0136f22 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:01.200988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056ec50-fe69-4b2a-b66d-d9643af1a083 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:01.201320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056ec50-fe69-4b2a-b66d-d9643af1a083 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:01.201561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056ec50-fe69-4b2a-b66d-d9643af1a083 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:01.203221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 51/100] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:01.219547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca560e2-892a-45a4-bce2-cf4a30e50697 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:01.219902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca560e2-892a-45a4-bce2-cf4a30e50697 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:01.220111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca560e2-892a-45a4-bce2-cf4a30e50697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:01.252224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-eca560e2-892a-45a4-bce2-cf4a30e50697 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:01.253982 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-eca560e2-892a-45a4-bce2-cf4a30e50697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:01.288845 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dec00-3283-45f2-b0e0-7fe9a0136f22 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:01.324414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52710f02-7b88-4a5b-87f3-715a05968508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:01.325248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52710f02-7b88-4a5b-87f3-715a05968508 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:01.325579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52710f02-7b88-4a5b-87f3-715a05968508 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:01.325866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52710f02-7b88-4a5b-87f3-715a05968508 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:01.327046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52710f02-7b88-4a5b-87f3-715a05968508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:01.328569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52710f02-7b88-4a5b-87f3-715a05968508 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:01.331888 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 50/101] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:01.337783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52710f02-7b88-4a5b-87f3-715a05968508 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:01.355429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 52/102] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:01.381686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca560e2-892a-45a4-bce2-cf4a30e50697 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:01.491989 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca560e2-892a-45a4-bce2-cf4a30e50697 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:01.528775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0379-2631-42e8-a522-06ce294863d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:01.529520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0379-2631-42e8-a522-06ce294863d1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:01.529811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0379-2631-42e8-a522-06ce294863d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:01.530092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0379-2631-42e8-a522-06ce294863d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:01.542339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f0379-2631-42e8-a522-06ce294863d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-8c9f0379-2631-42e8-a522-06ce294863d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:01.551077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:01.553166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:01.555080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 53/103] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:01.559030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0379-2631-42e8-a522-06ce294863d1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:01.613881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52710f02-7b88-4a5b-87f3-715a05968508 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:01.667109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0379-2631-42e8-a522-06ce294863d1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:01.705484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1efdf-8f87-4667-a769-8ce2800438c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:01.706201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1efdf-8f87-4667-a769-8ce2800438c8 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:01.706492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1efdf-8f87-4667-a769-8ce2800438c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:01.706774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1efdf-8f87-4667-a769-8ce2800438c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:01.707577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1efdf-8f87-4667-a769-8ce2800438c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:01.707890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1efdf-8f87-4667-a769-8ce2800438c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:01.709412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1efdf-8f87-4667-a769-8ce2800438c8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:01.711838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa6af-db11-4dd8-b789-446f4b84a22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:01.712527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa6af-db11-4dd8-b789-446f4b84a22a None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:01.712813 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa6af-db11-4dd8-b789-446f4b84a22a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:01.713091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa6af-db11-4dd8-b789-446f4b84a22a None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:01.713807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaa6af-db11-4dd8-b789-446f4b84a22a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:01.715311 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaa6af-db11-4dd8-b789-446f4b84a22a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:01.717932 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 54/104] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:01.724206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1efdf-8f87-4667-a769-8ce2800438c8 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:01.828200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1efdf-8f87-4667-a769-8ce2800438c8 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:01.861770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0a2ea-cd5b-425c-9c22-b45cc7b00f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:01.863260 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0a2ea-cd5b-425c-9c22-b45cc7b00f9f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:01.864948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0a2ea-cd5b-425c-9c22-b45cc7b00f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:01.864948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0a2ea-cd5b-425c-9c22-b45cc7b00f9f None admin] PATH_INFO: `/v3/users/36a807b86d1d467ba22ca3081bd051e8` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:01.869227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 51/105] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:07:01 2022] POST /identity/v3/projects => generated 302 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:07:01.881761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0a2ea-cd5b-425c-9c22-b45cc7b00f9f None admin] RBAC: Authorizing `identity:get_user(user_id=36a807b86d1d467ba22ca3081bd051e8)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:01.883362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0a2ea-cd5b-425c-9c22-b45cc7b00f9f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:01.885347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 55/106] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:01 2022] GET /identity/v3/users/36a807b86d1d467ba22ca3081bd051e8 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:01.890995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa6af-db11-4dd8-b789-446f4b84a22a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:02.046822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa6af-db11-4dd8-b789-446f4b84a22a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:02.099736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febf6e3-c4c9-4d1d-8ed2-1cb9c9c3c6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:02.100763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febf6e3-c4c9-4d1d-8ed2-1cb9c9c3c6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:02.101244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febf6e3-c4c9-4d1d-8ed2-1cb9c9c3c6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:02.101709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febf6e3-c4c9-4d1d-8ed2-1cb9c9c3c6c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:02.181299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febf6e3-c4c9-4d1d-8ed2-1cb9c9c3c6c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:02.183102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febf6e3-c4c9-4d1d-8ed2-1cb9c9c3c6c2 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:02.297815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 52/107] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:02.299501 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0a2ea-cd5b-425c-9c22-b45cc7b00f9f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:02.410904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0a2ea-cd5b-425c-9c22-b45cc7b00f9f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:02.417385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7405b4-445e-46ef-9612-1b0a981bf7e7 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:02.417911 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7405b4-445e-46ef-9612-1b0a981bf7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:02.418370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7405b4-445e-46ef-9612-1b0a981bf7e7 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:02.419992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 53/108] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:02.426257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef615-21e7-4029-ad26-b087be51a65d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:02.426820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef615-21e7-4029-ad26-b087be51a65d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:02.427381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef615-21e7-4029-ad26-b087be51a65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:02.456686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac8229-afb2-4cb4-aad4-a065cfa08dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:02.457569 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac8229-afb2-4cb4-aad4-a065cfa08dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:02.457853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac8229-afb2-4cb4-aad4-a065cfa08dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:02.458129 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac8229-afb2-4cb4-aad4-a065cfa08dc9 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:02.462849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac8229-afb2-4cb4-aad4-a065cfa08dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:02.464375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac8229-afb2-4cb4-aad4-a065cfa08dc9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:02.466145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 56/109] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:02 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:02.467159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-801ef615-21e7-4029-ad26-b087be51a65d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:02.468369 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-801ef615-21e7-4029-ad26-b087be51a65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:02.474890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac8229-afb2-4cb4-aad4-a065cfa08dc9 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:02.593375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 54/110] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:02.639315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac8229-afb2-4cb4-aad4-a065cfa08dc9 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:02.649103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef615-21e7-4029-ad26-b087be51a65d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:02.723961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a8fcb-ae78-4f54-a494-914101b333dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:02.724558 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a8fcb-ae78-4f54-a494-914101b333dc None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:02.724854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a8fcb-ae78-4f54-a494-914101b333dc None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:02.725137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a8fcb-ae78-4f54-a494-914101b333dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:02.725986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a8fcb-ae78-4f54-a494-914101b333dc None admin] RBAC: Adding query filter params (role.id=857d25aa9bd04e0b90ba9a17aba49c51, scope.project.id=17128730ad3c43e194e508cc0fcd24cb, user.id=36a807b86d1d467ba22ca3081bd051e8) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:02.726299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a8fcb-ae78-4f54-a494-914101b333dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:02.727917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a8fcb-ae78-4f54-a494-914101b333dc None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:02.737856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 57/111] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:02 2022] GET /identity/v3/role_assignments?user.id=36a807b86d1d467ba22ca3081bd051e8&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=857d25aa9bd04e0b90ba9a17aba49c51 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:02.772926 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef615-21e7-4029-ad26-b087be51a65d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:02.814408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc68cc4-f8f8-42a4-bab6-57f9f873cd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:02.815340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc68cc4-f8f8-42a4-bab6-57f9f873cd49 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:02.816159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc68cc4-f8f8-42a4-bab6-57f9f873cd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:02.816442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc68cc4-f8f8-42a4-bab6-57f9f873cd49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:02.832756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc68cc4-f8f8-42a4-bab6-57f9f873cd49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-4fc68cc4-f8f8-42a4-bab6-57f9f873cd49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:02.840658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:02.842852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:02.844795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 55/112] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:07:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:02.850998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7afb-20fe-4213-961c-b572b67a6039 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:02.850998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7afb-20fe-4213-961c-b572b67a6039 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:02.850998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7afb-20fe-4213-961c-b572b67a6039 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:02.850998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 58/113] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:02.853741 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc68cc4-f8f8-42a4-bab6-57f9f873cd49 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:02.879647 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a255853-e316-4ed8-a365-3d79ebaf316c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:02.879965 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a255853-e316-4ed8-a365-3d79ebaf316c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:02.880204 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a255853-e316-4ed8-a365-3d79ebaf316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:02.906954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-2a255853-e316-4ed8-a365-3d79ebaf316c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:02.908193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2a255853-e316-4ed8-a365-3d79ebaf316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:03.044746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc68cc4-f8f8-42a4-bab6-57f9f873cd49 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:03.105518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 59/114] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:03.121692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7077c-2734-4cf9-b1bf-2842c44d14b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:03.122478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7077c-2734-4cf9-b1bf-2842c44d14b5 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:03.122767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7077c-2734-4cf9-b1bf-2842c44d14b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:03.123042 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7077c-2734-4cf9-b1bf-2842c44d14b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:03.123826 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7077c-2734-4cf9-b1bf-2842c44d14b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:03.124134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7077c-2734-4cf9-b1bf-2842c44d14b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:03.125560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7077c-2734-4cf9-b1bf-2842c44d14b5 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:03.142529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 56/115] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:03.142985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a255853-e316-4ed8-a365-3d79ebaf316c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:03.150292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7077c-2734-4cf9-b1bf-2842c44d14b5 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:03.329074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a255853-e316-4ed8-a365-3d79ebaf316c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:03.342976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7077c-2734-4cf9-b1bf-2842c44d14b5 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:03.360872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c1352-3673-4b7c-9b97-fd5b9a1ea7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:03.369271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c1352-3673-4b7c-9b97-fd5b9a1ea7ce None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:03.369271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c1352-3673-4b7c-9b97-fd5b9a1ea7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:03.369271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c1352-3673-4b7c-9b97-fd5b9a1ea7ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:03.374861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c1352-3673-4b7c-9b97-fd5b9a1ea7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-715c1352-3673-4b7c-9b97-fd5b9a1ea7ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:03.384172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:03.386677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 60/116] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:03.388650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae668682-76e8-4d21-bc9f-e08d538514b5 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:03.390567 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae668682-76e8-4d21-bc9f-e08d538514b5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:03.390567 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae668682-76e8-4d21-bc9f-e08d538514b5 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:03.394630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 61/117] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:03.395632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae668682-76e8-4d21-bc9f-e08d538514b5 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:03.432457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd66210-5bf3-46b2-821c-4440522b094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:03.433349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd66210-5bf3-46b2-821c-4440522b094b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:03.433632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd66210-5bf3-46b2-821c-4440522b094b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:03.433910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd66210-5bf3-46b2-821c-4440522b094b None admin] PATH_INFO: `/v3/users/3163ceb80e1143e28503836c92928e92` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:03.439923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd66210-5bf3-46b2-821c-4440522b094b None admin] RBAC: Authorizing `identity:get_user(user_id=3163ceb80e1143e28503836c92928e92)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:03.442003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd66210-5bf3-46b2-821c-4440522b094b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:03.443734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 57/118] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:03 2022] GET /identity/v3/users/3163ceb80e1143e28503836c92928e92 => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:03.445008 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e17ba-7a78-4ee6-8b5a-10fdf10babcf None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:03.445212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e17ba-7a78-4ee6-8b5a-10fdf10babcf None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:03.445487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e17ba-7a78-4ee6-8b5a-10fdf10babcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:03.483312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d16e17ba-7a78-4ee6-8b5a-10fdf10babcf None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:03.484547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d16e17ba-7a78-4ee6-8b5a-10fdf10babcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:03.516995 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae668682-76e8-4d21-bc9f-e08d538514b5 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:03.554275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fbb5e-5500-40fa-8f18-d5e9f9b8c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:03.555053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fbb5e-5500-40fa-8f18-d5e9f9b8c5ca None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:03.555375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fbb5e-5500-40fa-8f18-d5e9f9b8c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:03.555656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fbb5e-5500-40fa-8f18-d5e9f9b8c5ca None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:03.556973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fbb5e-5500-40fa-8f18-d5e9f9b8c5ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:03.557294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fbb5e-5500-40fa-8f18-d5e9f9b8c5ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:03.558760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fbb5e-5500-40fa-8f18-d5e9f9b8c5ca None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:03.569927 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 62/119] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:03.570763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fbb5e-5500-40fa-8f18-d5e9f9b8c5ca None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:03.640514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 58/120] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:03.641384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e17ba-7a78-4ee6-8b5a-10fdf10babcf None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:03.691507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fbb5e-5500-40fa-8f18-d5e9f9b8c5ca None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:03.734771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21486-f5a2-47d9-8378-e685690e4ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:03.735677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21486-f5a2-47d9-8378-e685690e4ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:03.735965 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21486-f5a2-47d9-8378-e685690e4ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:03.736247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21486-f5a2-47d9-8378-e685690e4ea0 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:03.738020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f21486-f5a2-47d9-8378-e685690e4ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:03.739660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f21486-f5a2-47d9-8378-e685690e4ea0 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:03.741379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 63/121] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:03 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:03.742592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363d26-7397-4ccc-a123-1b59f5eb3071 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:03.742924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363d26-7397-4ccc-a123-1b59f5eb3071 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:03.743233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363d26-7397-4ccc-a123-1b59f5eb3071 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:03.744540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 64/122] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:03.744809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e17ba-7a78-4ee6-8b5a-10fdf10babcf None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:03.745240 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363d26-7397-4ccc-a123-1b59f5eb3071 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:03.778916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65642ea-e8c4-4e38-b52d-1cae484ebe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:03.779826 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65642ea-e8c4-4e38-b52d-1cae484ebe5b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:03.780112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65642ea-e8c4-4e38-b52d-1cae484ebe5b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:03.780440 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65642ea-e8c4-4e38-b52d-1cae484ebe5b None admin] PATH_INFO: `/v3/users/90fb781936154a33addfe7c9d4af6617` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:03.781680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65642ea-e8c4-4e38-b52d-1cae484ebe5b None admin] RBAC: Authorizing `identity:get_user(user_id=90fb781936154a33addfe7c9d4af6617)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:03.783272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65642ea-e8c4-4e38-b52d-1cae484ebe5b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:03.785792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 59/123] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:03 2022] GET /identity/v3/users/90fb781936154a33addfe7c9d4af6617 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:03.787011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f15333-aba2-4492-8513-9635fec7d1cd None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:03.787325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f15333-aba2-4492-8513-9635fec7d1cd None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:03.787656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f15333-aba2-4492-8513-9635fec7d1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:03.805981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-40f15333-aba2-4492-8513-9635fec7d1cd None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:03.807205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-40f15333-aba2-4492-8513-9635fec7d1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:03.848358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363d26-7397-4ccc-a123-1b59f5eb3071 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:03.875563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 60/124] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:03.876457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f15333-aba2-4492-8513-9635fec7d1cd None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:03.883406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d18f4-6795-4cfa-842a-4a80d50b5d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:03.884227 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d18f4-6795-4cfa-842a-4a80d50b5d28 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:03.884516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d18f4-6795-4cfa-842a-4a80d50b5d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:03.884791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d18f4-6795-4cfa-842a-4a80d50b5d28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:03.895660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d18f4-6795-4cfa-842a-4a80d50b5d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-609d18f4-6795-4cfa-842a-4a80d50b5d28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:03.903801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:03.906153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 65/125] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:03.908156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d18f4-6795-4cfa-842a-4a80d50b5d28 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:03.978764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f15333-aba2-4492-8513-9635fec7d1cd None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:04.012194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d18f4-6795-4cfa-842a-4a80d50b5d28 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:04.012999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18906466-b02b-4c88-ba34-e0380a4b1145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:04.013895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18906466-b02b-4c88-ba34-e0380a4b1145 None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:04.014179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18906466-b02b-4c88-ba34-e0380a4b1145 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:04.014454 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18906466-b02b-4c88-ba34-e0380a4b1145 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb/users/3163ceb80e1143e28503836c92928e92/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:04.016490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18906466-b02b-4c88-ba34-e0380a4b1145 None admin] RBAC: Authorizing `identity:create_grant(project_id=17128730ad3c43e194e508cc0fcd24cb, user_id=3163ceb80e1143e28503836c92928e92, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:04.018068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18906466-b02b-4c88-ba34-e0380a4b1145 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:04.046449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657657c-67e1-4a1a-94a6-2c73d862959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:04.047418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657657c-67e1-4a1a-94a6-2c73d862959e None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:04.047714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657657c-67e1-4a1a-94a6-2c73d862959e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:04.047994 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657657c-67e1-4a1a-94a6-2c73d862959e None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:04.049187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657657c-67e1-4a1a-94a6-2c73d862959e None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:04.050675 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657657c-67e1-4a1a-94a6-2c73d862959e None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:04.052488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 66/126] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:03 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:04.053253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657657c-67e1-4a1a-94a6-2c73d862959e None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:04.114515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 61/127] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:07:03 2022] PUT /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb/users/3163ceb80e1143e28503836c92928e92/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:04.115395 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18906466-b02b-4c88-ba34-e0380a4b1145 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:04.213264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657657c-67e1-4a1a-94a6-2c73d862959e None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:04.295382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecef2-94fd-4450-af5f-46a8cb913045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:04.299191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecef2-94fd-4450-af5f-46a8cb913045 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:04.299191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecef2-94fd-4450-af5f-46a8cb913045 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:04.299191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecef2-94fd-4450-af5f-46a8cb913045 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:04.299191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cecef2-94fd-4450-af5f-46a8cb913045 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:04.299821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18906466-b02b-4c88-ba34-e0380a4b1145 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:04.300582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cecef2-94fd-4450-af5f-46a8cb913045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:04.300582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cecef2-94fd-4450-af5f-46a8cb913045 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:04.308802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 67/128] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:04.309723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecef2-94fd-4450-af5f-46a8cb913045 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:04.381510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c933a62-80f3-4982-b64e-f80f4705e171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:04.382685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933a62-80f3-4982-b64e-f80f4705e171 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:04.383203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933a62-80f3-4982-b64e-f80f4705e171 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:04.383681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933a62-80f3-4982-b64e-f80f4705e171 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:04.404706 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c933a62-80f3-4982-b64e-f80f4705e171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-7c933a62-80f3-4982-b64e-f80f4705e171 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:04.413645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:04.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:04.415547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:04.418068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 62/129] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:04.422896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecef2-94fd-4450-af5f-46a8cb913045 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:04.424531 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c933a62-80f3-4982-b64e-f80f4705e171 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:04.459524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9ef12-04fe-4b38-9f6d-d1fc2870cdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:04.460531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9ef12-04fe-4b38-9f6d-d1fc2870cdcc None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:04.460832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9ef12-04fe-4b38-9f6d-d1fc2870cdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:04.461109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9ef12-04fe-4b38-9f6d-d1fc2870cdcc None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb/users/90fb781936154a33addfe7c9d4af6617/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:04.463950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9ef12-04fe-4b38-9f6d-d1fc2870cdcc None admin] RBAC: Authorizing `identity:create_grant(project_id=17128730ad3c43e194e508cc0fcd24cb, user_id=90fb781936154a33addfe7c9d4af6617, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:04.465418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9ef12-04fe-4b38-9f6d-d1fc2870cdcc None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:04.546540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c933a62-80f3-4982-b64e-f80f4705e171 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:04.560776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 68/130] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:07:04 2022] PUT /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb/users/90fb781936154a33addfe7c9d4af6617/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:04.561749 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9ef12-04fe-4b38-9f6d-d1fc2870cdcc None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:04.635917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29ec4b-fd66-47c4-9fe5-034edfdf198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:04.637650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29ec4b-fd66-47c4-9fe5-034edfdf198f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:04.638275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29ec4b-fd66-47c4-9fe5-034edfdf198f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:04.639264 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29ec4b-fd66-47c4-9fe5-034edfdf198f None admin] PATH_INFO: `/v3/users/90fb781936154a33addfe7c9d4af6617` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:04.644231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29ec4b-fd66-47c4-9fe5-034edfdf198f None admin] RBAC: Authorizing `identity:get_user(user_id=90fb781936154a33addfe7c9d4af6617)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:04.646583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29ec4b-fd66-47c4-9fe5-034edfdf198f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:04.650888 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 63/131] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:04 2022] GET /identity/v3/users/90fb781936154a33addfe7c9d4af6617 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:04.657077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29ec4b-fd66-47c4-9fe5-034edfdf198f None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:04.778467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9ef12-04fe-4b38-9f6d-d1fc2870cdcc None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:04.848266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1544532-bcaf-4a89-b1f9-dabec4cd2c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:04.848955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544532-bcaf-4a89-b1f9-dabec4cd2c0d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:04.849243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544532-bcaf-4a89-b1f9-dabec4cd2c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:04.849524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544532-bcaf-4a89-b1f9-dabec4cd2c0d None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:04.850283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1544532-bcaf-4a89-b1f9-dabec4cd2c0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:04.850599 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1544532-bcaf-4a89-b1f9-dabec4cd2c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:04.852041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1544532-bcaf-4a89-b1f9-dabec4cd2c0d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:04.861678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 69/132] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:04.862868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29ec4b-fd66-47c4-9fe5-034edfdf198f None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:04.876351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1544532-bcaf-4a89-b1f9-dabec4cd2c0d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:04.944857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80868c76-8674-4dea-832a-213e404c5c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:04.946005 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868c76-8674-4dea-832a-213e404c5c1d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:04.946442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868c76-8674-4dea-832a-213e404c5c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:04.946876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868c76-8674-4dea-832a-213e404c5c1d None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:04.949526 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80868c76-8674-4dea-832a-213e404c5c1d None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:04.952172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80868c76-8674-4dea-832a-213e404c5c1d None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:04.954094 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 64/133] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:04 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:04.955509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1461c-8e8e-4544-9ec7-fa859aea461f None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:04.955995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1461c-8e8e-4544-9ec7-fa859aea461f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:04.956406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1461c-8e8e-4544-9ec7-fa859aea461f None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:04.958449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 65/134] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:04.962957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1461c-8e8e-4544-9ec7-fa859aea461f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:05.032439 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1544532-bcaf-4a89-b1f9-dabec4cd2c0d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:05.086534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1461c-8e8e-4544-9ec7-fa859aea461f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:05.094427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d828942-d039-4775-b1bc-811c434a0878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:05.095866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d828942-d039-4775-b1bc-811c434a0878 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:05.095866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d828942-d039-4775-b1bc-811c434a0878 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:05.096061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d828942-d039-4775-b1bc-811c434a0878 None admin] PATH_INFO: `/v3/users/90fb781936154a33addfe7c9d4af6617` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:05.098490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d828942-d039-4775-b1bc-811c434a0878 None admin] RBAC: Authorizing `identity:get_user(user_id=90fb781936154a33addfe7c9d4af6617)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:05.100009 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d828942-d039-4775-b1bc-811c434a0878 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:05.104372 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 70/135] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:04 2022] GET /identity/v3/users/90fb781936154a33addfe7c9d4af6617 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:05.105584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e89df1-c609-4f02-ad68-48e75e104726 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:05.106095 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e89df1-c609-4f02-ad68-48e75e104726 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:05.106379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e89df1-c609-4f02-ad68-48e75e104726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:05.137704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c2e89df1-c609-4f02-ad68-48e75e104726 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:05.139155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c2e89df1-c609-4f02-ad68-48e75e104726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:05.151461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4918-c537-4453-9b7e-ae51546c4b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:05.152428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4918-c537-4453-9b7e-ae51546c4b42 None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:05.152713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4918-c537-4453-9b7e-ae51546c4b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:05.152992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4918-c537-4453-9b7e-ae51546c4b42 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb/users/90fb781936154a33addfe7c9d4af6617/roles/1efabb1110d64eebacd85d9016d7d286` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:05.160375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e4918-c537-4453-9b7e-ae51546c4b42 None admin] RBAC: Authorizing `identity:create_grant(project_id=17128730ad3c43e194e508cc0fcd24cb, user_id=90fb781936154a33addfe7c9d4af6617, role_id=1efabb1110d64eebacd85d9016d7d286)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:05.161986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e4918-c537-4453-9b7e-ae51546c4b42 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:05.219233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 71/136] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:05.219887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e89df1-c609-4f02-ad68-48e75e104726 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:05.249383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 66/137] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:07:04 2022] PUT /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb/users/90fb781936154a33addfe7c9d4af6617/roles/1efabb1110d64eebacd85d9016d7d286 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:05.288772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4918-c537-4453-9b7e-ae51546c4b42 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:05.326328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e89df1-c609-4f02-ad68-48e75e104726 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:05.361868 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c4edf-091b-4596-95db-0ca66401ddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:05.363357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4edf-091b-4596-95db-0ca66401ddea None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:05.363649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4edf-091b-4596-95db-0ca66401ddea None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:05.363934 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4edf-091b-4596-95db-0ca66401ddea None admin] PATH_INFO: `/v3/projects/d2b0c1935ce64c42941dd272713e4a00` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:05.367166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c4edf-091b-4596-95db-0ca66401ddea None admin] RBAC: Authorizing `identity:get_project(project_id=d2b0c1935ce64c42941dd272713e4a00)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:05.367166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c4edf-091b-4596-95db-0ca66401ddea None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:05.368589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 72/138] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:05 2022] GET /identity/v3/projects/d2b0c1935ce64c42941dd272713e4a00 => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:05.374387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c4edf-091b-4596-95db-0ca66401ddea None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:05.492469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c4edf-091b-4596-95db-0ca66401ddea None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:05.529394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4918-c537-4453-9b7e-ae51546c4b42 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:05.554359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243d6aa-545a-4011-abdc-d3dae443531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:05.556172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243d6aa-545a-4011-abdc-d3dae443531c None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:05.556463 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243d6aa-545a-4011-abdc-d3dae443531c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:05.556745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243d6aa-545a-4011-abdc-d3dae443531c None admin] PATH_INFO: `/v3/projects/d2b0c1935ce64c42941dd272713e4a00/users/90fb781936154a33addfe7c9d4af6617/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:05.561963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243d6aa-545a-4011-abdc-d3dae443531c None admin] RBAC: Authorizing `identity:create_grant(project_id=d2b0c1935ce64c42941dd272713e4a00, user_id=90fb781936154a33addfe7c9d4af6617, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:05.563471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243d6aa-545a-4011-abdc-d3dae443531c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:05.581749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160885e-7a18-4676-9339-c28689623363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:05.583409 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160885e-7a18-4676-9339-c28689623363 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:05.584122 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160885e-7a18-4676-9339-c28689623363 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:05.584822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160885e-7a18-4676-9339-c28689623363 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:05.587211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160885e-7a18-4676-9339-c28689623363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:05.589823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160885e-7a18-4676-9339-c28689623363 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:05.592801 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 67/139] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:05.598092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160885e-7a18-4676-9339-c28689623363 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:05.669432 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 73/140] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:07:05 2022] PUT /identity/v3/projects/d2b0c1935ce64c42941dd272713e4a00/users/90fb781936154a33addfe7c9d4af6617/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:07:05.728488 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160885e-7a18-4676-9339-c28689623363 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:05.768878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad214f-48c0-41a9-8b7b-5f4d050486e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:05.769567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad214f-48c0-41a9-8b7b-5f4d050486e2 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:05.769856 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad214f-48c0-41a9-8b7b-5f4d050486e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:05.770139 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad214f-48c0-41a9-8b7b-5f4d050486e2 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:05.770936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad214f-48c0-41a9-8b7b-5f4d050486e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:05.772452 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad214f-48c0-41a9-8b7b-5f4d050486e2 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:05.866046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 68/141] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:07:05 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:07:06.270827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ce7dd-f584-4cc1-b94c-d40627aecce2 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:06.271019 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ce7dd-f584-4cc1-b94c-d40627aecce2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:06.271337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ce7dd-f584-4cc1-b94c-d40627aecce2 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:06.272732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 74/142] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:06.278242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dff5a-61ef-4775-a87d-918e1c47c6ed None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:06.278540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dff5a-61ef-4775-a87d-918e1c47c6ed None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:06.278827 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dff5a-61ef-4775-a87d-918e1c47c6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:06.305200 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0f4dff5a-61ef-4775-a87d-918e1c47c6ed None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:06.306447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0f4dff5a-61ef-4775-a87d-918e1c47c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:06.388135 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 69/143] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:06.421963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ce7dd-f584-4cc1-b94c-d40627aecce2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:06.552342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ce7dd-f584-4cc1-b94c-d40627aecce2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:06.592452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901dc55-f2ed-43e7-bd93-abf5df6cf811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:06.593627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901dc55-f2ed-43e7-bd93-abf5df6cf811 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:06.594125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901dc55-f2ed-43e7-bd93-abf5df6cf811 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:06.594597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901dc55-f2ed-43e7-bd93-abf5df6cf811 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:06.607961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901dc55-f2ed-43e7-bd93-abf5df6cf811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-6901dc55-f2ed-43e7-bd93-abf5df6cf811 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:06.616551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:06.617393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:06.618143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:06.620481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 75/144] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:06.628873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dff5a-61ef-4775-a87d-918e1c47c6ed None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:06.772009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dff5a-61ef-4775-a87d-918e1c47c6ed None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:06.817448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1a67-20e7-4643-90f9-f629a3256163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:06.818056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1a67-20e7-4643-90f9-f629a3256163 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:06.818342 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1a67-20e7-4643-90f9-f629a3256163 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:06.818620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1a67-20e7-4643-90f9-f629a3256163 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:06.819450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1a67-20e7-4643-90f9-f629a3256163 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:06.819759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1a67-20e7-4643-90f9-f629a3256163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:06.821233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1a67-20e7-4643-90f9-f629a3256163 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:06.830579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 70/145] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:06.836736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901dc55-f2ed-43e7-bd93-abf5df6cf811 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:06.985313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901dc55-f2ed-43e7-bd93-abf5df6cf811 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:07.025571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41df4-f372-4b98-9055-dcad285d0e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:07.026806 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41df4-f372-4b98-9055-dcad285d0e72 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:07.027293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41df4-f372-4b98-9055-dcad285d0e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:07.027813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41df4-f372-4b98-9055-dcad285d0e72 None admin] PATH_INFO: `/v3/users/36a807b86d1d467ba22ca3081bd051e8` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:07.029328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41df4-f372-4b98-9055-dcad285d0e72 None admin] RBAC: Authorizing `identity:get_user(user_id=36a807b86d1d467ba22ca3081bd051e8)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:07.031011 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41df4-f372-4b98-9055-dcad285d0e72 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:07.032905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 76/146] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:06 2022] GET /identity/v3/users/36a807b86d1d467ba22ca3081bd051e8 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:07.038677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1a67-20e7-4643-90f9-f629a3256163 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:07.179974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e26b1-5e6f-46c2-808c-fe696e99a439 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:07.180555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e26b1-5e6f-46c2-808c-fe696e99a439 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:07.181033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e26b1-5e6f-46c2-808c-fe696e99a439 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:07.182589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 77/147] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:07.188932 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551c120-994b-4567-956b-08b8e53836c2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:07.189456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551c120-994b-4567-956b-08b8e53836c2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:07.189910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551c120-994b-4567-956b-08b8e53836c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:07.207250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1a67-20e7-4643-90f9-f629a3256163 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:07.223263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-6551c120-994b-4567-956b-08b8e53836c2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:07.224735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-6551c120-994b-4567-956b-08b8e53836c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:07.257426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11044b6-64b1-4c02-88f1-b140c8a34e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:07.258456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11044b6-64b1-4c02-88f1-b140c8a34e91 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:07.258931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11044b6-64b1-4c02-88f1-b140c8a34e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:07.259244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11044b6-64b1-4c02-88f1-b140c8a34e91 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:07.261305 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11044b6-64b1-4c02-88f1-b140c8a34e91 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:07.263106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11044b6-64b1-4c02-88f1-b140c8a34e91 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:07.265226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 71/148] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:07 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:07.272844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11044b6-64b1-4c02-88f1-b140c8a34e91 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:07.364333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 78/149] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:07.405632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551c120-994b-4567-956b-08b8e53836c2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:07.438936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11044b6-64b1-4c02-88f1-b140c8a34e91 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:07.485026 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77087d-338c-436f-beed-fc1021a41dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:07.486219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77087d-338c-436f-beed-fc1021a41dae None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:07.486673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77087d-338c-436f-beed-fc1021a41dae None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:07.487725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77087d-338c-436f-beed-fc1021a41dae None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb/users/36a807b86d1d467ba22ca3081bd051e8/roles/857d25aa9bd04e0b90ba9a17aba49c51` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:07.490700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77087d-338c-436f-beed-fc1021a41dae None admin] RBAC: Authorizing `identity:create_grant(project_id=17128730ad3c43e194e508cc0fcd24cb, user_id=36a807b86d1d467ba22ca3081bd051e8, role_id=857d25aa9bd04e0b90ba9a17aba49c51)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:07.492424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77087d-338c-436f-beed-fc1021a41dae None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:07.575322 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551c120-994b-4567-956b-08b8e53836c2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:07.585950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 72/150] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:07:07 2022] PUT /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb/users/36a807b86d1d467ba22ca3081bd051e8/roles/857d25aa9bd04e0b90ba9a17aba49c51 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:07.626295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab62e06-49a6-4e6a-afc6-9157a32aee81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:07.627271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62e06-49a6-4e6a-afc6-9157a32aee81 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:07.627563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62e06-49a6-4e6a-afc6-9157a32aee81 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:07.627925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62e06-49a6-4e6a-afc6-9157a32aee81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:07.639387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab62e06-49a6-4e6a-afc6-9157a32aee81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-eab62e06-49a6-4e6a-afc6-9157a32aee81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:07.647651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:07.648536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:07.649746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 79/151] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:07:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:07.655295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77087d-338c-436f-beed-fc1021a41dae None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:07.672642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecb377-1f2f-4abf-a17e-4dc5da567c4a None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:07.672955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecb377-1f2f-4abf-a17e-4dc5da567c4a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:07.673209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecb377-1f2f-4abf-a17e-4dc5da567c4a None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:07.675737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 80/152] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:07.686409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf9306-5763-483c-a014-351c6e6b13da None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:07.686704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf9306-5763-483c-a014-351c6e6b13da None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:07.686974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf9306-5763-483c-a014-351c6e6b13da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:07.718212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-83bf9306-5763-483c-a014-351c6e6b13da None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:07.722446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-83bf9306-5763-483c-a014-351c6e6b13da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:07.799476 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 81/153] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:07.836567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77087d-338c-436f-beed-fc1021a41dae None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:07.851907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf9306-5763-483c-a014-351c6e6b13da None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:07.899920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb52e-d5f2-46f7-a694-dae7f056b94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:07.901015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb52e-d5f2-46f7-a694-dae7f056b94f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:07.901517 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb52e-d5f2-46f7-a694-dae7f056b94f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:07.902012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdb52e-d5f2-46f7-a694-dae7f056b94f None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:07.902981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdb52e-d5f2-46f7-a694-dae7f056b94f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:07.903516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdb52e-d5f2-46f7-a694-dae7f056b94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:07.905174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdb52e-d5f2-46f7-a694-dae7f056b94f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:07.917312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 73/154] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:07.922888 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb52e-d5f2-46f7-a694-dae7f056b94f None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:07.984446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf9306-5763-483c-a014-351c6e6b13da None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:08.032188 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cab648-6bf7-46be-8381-c0b2f1a7094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:08.033261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cab648-6bf7-46be-8381-c0b2f1a7094d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:08.033686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cab648-6bf7-46be-8381-c0b2f1a7094d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:08.034236 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cab648-6bf7-46be-8381-c0b2f1a7094d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:08.050417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cab648-6bf7-46be-8381-c0b2f1a7094d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-57cab648-6bf7-46be-8381-c0b2f1a7094d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:08.062838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:08.063775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:08.064534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:08.071955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 82/155] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:08.077475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cab648-6bf7-46be-8381-c0b2f1a7094d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:08.128698 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdb52e-d5f2-46f7-a694-dae7f056b94f None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:08.203984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cab648-6bf7-46be-8381-c0b2f1a7094d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:08.220468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c062342-4708-42a4-b510-7e44db31a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:08.221372 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c062342-4708-42a4-b510-7e44db31a684 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:08.222202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c062342-4708-42a4-b510-7e44db31a684 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:08.222484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c062342-4708-42a4-b510-7e44db31a684 None admin] PATH_INFO: `/v3/users/3163ceb80e1143e28503836c92928e92` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:08.227080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c062342-4708-42a4-b510-7e44db31a684 None admin] RBAC: Authorizing `identity:get_user(user_id=3163ceb80e1143e28503836c92928e92)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:08.228855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c062342-4708-42a4-b510-7e44db31a684 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:08.230993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 74/156] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:07 2022] GET /identity/v3/users/3163ceb80e1143e28503836c92928e92 => generated 247 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:08.236552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c062342-4708-42a4-b510-7e44db31a684 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:08.241395 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba4413-1d69-429c-81a9-21b5f627be88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:08.242311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba4413-1d69-429c-81a9-21b5f627be88 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:08.242770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba4413-1d69-429c-81a9-21b5f627be88 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:08.243246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba4413-1d69-429c-81a9-21b5f627be88 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:08.244218 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba4413-1d69-429c-81a9-21b5f627be88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:08.244699 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba4413-1d69-429c-81a9-21b5f627be88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:08.246288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba4413-1d69-429c-81a9-21b5f627be88 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:08.255062 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 83/157] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:08.260406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba4413-1d69-429c-81a9-21b5f627be88 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:08.381470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba4413-1d69-429c-81a9-21b5f627be88 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:08.415694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b188f1-e2eb-4158-bb8c-aeaa83902972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:08.416955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b188f1-e2eb-4158-bb8c-aeaa83902972 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:08.417435 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b188f1-e2eb-4158-bb8c-aeaa83902972 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:08.417961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b188f1-e2eb-4158-bb8c-aeaa83902972 None admin] PATH_INFO: `/v3/users/90fb781936154a33addfe7c9d4af6617` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:08.419448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b188f1-e2eb-4158-bb8c-aeaa83902972 None admin] RBAC: Authorizing `identity:get_user(user_id=90fb781936154a33addfe7c9d4af6617)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:08.421338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b188f1-e2eb-4158-bb8c-aeaa83902972 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:08.423213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 84/158] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:08 2022] GET /identity/v3/users/90fb781936154a33addfe7c9d4af6617 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:08.429252 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b188f1-e2eb-4158-bb8c-aeaa83902972 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:08.474341 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c062342-4708-42a4-b510-7e44db31a684 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:08.560711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b188f1-e2eb-4158-bb8c-aeaa83902972 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:08.565100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9248b5-bcb3-4a41-b462-a00fbc7a2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:08.565806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9248b5-bcb3-4a41-b462-a00fbc7a2862 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:08.566090 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9248b5-bcb3-4a41-b462-a00fbc7a2862 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:08.566364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9248b5-bcb3-4a41-b462-a00fbc7a2862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:08.608751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e206d80-83bc-4223-bbbf-3edc18dbf10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:08.609447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e206d80-83bc-4223-bbbf-3edc18dbf10d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:08.609696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e206d80-83bc-4223-bbbf-3edc18dbf10d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:08.609974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e206d80-83bc-4223-bbbf-3edc18dbf10d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:08.683430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9248b5-bcb3-4a41-b462-a00fbc7a2862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:08.684973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9248b5-bcb3-4a41-b462-a00fbc7a2862 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:08.760201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e206d80-83bc-4223-bbbf-3edc18dbf10d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:08.761697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e206d80-83bc-4223-bbbf-3edc18dbf10d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:08.806321 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 75/159] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 17:07:08.811863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9248b5-bcb3-4a41-b462-a00fbc7a2862 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:08.914544 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9248b5-bcb3-4a41-b462-a00fbc7a2862 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:08.949189 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77243681-9a25-49b7-b640-a9852c8ca446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:08.950056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243681-9a25-49b7-b640-a9852c8ca446 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:08.950340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243681-9a25-49b7-b640-a9852c8ca446 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:08.950622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243681-9a25-49b7-b640-a9852c8ca446 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:08.957015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77243681-9a25-49b7-b640-a9852c8ca446 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:08.959147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77243681-9a25-49b7-b640-a9852c8ca446 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:08.959670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 76/160] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:08 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:08.965032 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77243681-9a25-49b7-b640-a9852c8ca446 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:08.978972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 85/161] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 17:07:08.984442 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e206d80-83bc-4223-bbbf-3edc18dbf10d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:09.075847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77243681-9a25-49b7-b640-a9852c8ca446 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:09.110348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc51d39-c17e-48ec-b0c6-a8f9ad7f2733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:09.111015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc51d39-c17e-48ec-b0c6-a8f9ad7f2733 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:09.111338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc51d39-c17e-48ec-b0c6-a8f9ad7f2733 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:09.111613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc51d39-c17e-48ec-b0c6-a8f9ad7f2733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:09.113022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc51d39-c17e-48ec-b0c6-a8f9ad7f2733 None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=17128730ad3c43e194e508cc0fcd24cb, user.id=3163ceb80e1143e28503836c92928e92) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:09.113333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc51d39-c17e-48ec-b0c6-a8f9ad7f2733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:09.114869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc51d39-c17e-48ec-b0c6-a8f9ad7f2733 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:09.121154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 77/162] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:08 2022] GET /identity/v3/role_assignments?user.id=3163ceb80e1143e28503836c92928e92&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=2791519d9bad43318f086666b6e64a20 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:09.211053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e206d80-83bc-4223-bbbf-3edc18dbf10d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:09.251486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bf3b8-a9b7-4865-b210-b126279f3d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:09.252355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bf3b8-a9b7-4865-b210-b126279f3d54 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:09.252639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bf3b8-a9b7-4865-b210-b126279f3d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:09.252953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bf3b8-a9b7-4865-b210-b126279f3d54 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:09.259919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bf3b8-a9b7-4865-b210-b126279f3d54 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:09.261411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bf3b8-a9b7-4865-b210-b126279f3d54 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:09.263538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 86/163] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:08 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:09.269873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc51d39-c17e-48ec-b0c6-a8f9ad7f2733 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:09.291950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8d95a-3938-4456-b94e-91de36d7dd5f None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:09.292282 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8d95a-3938-4456-b94e-91de36d7dd5f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:09.292517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8d95a-3938-4456-b94e-91de36d7dd5f None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:09.294183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 87/164] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:09.299400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8b2bb-6db9-43e9-9305-8546304c51fe None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:09.299727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8b2bb-6db9-43e9-9305-8546304c51fe None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:09.300009 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8b2bb-6db9-43e9-9305-8546304c51fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:09.340276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a7f8b2bb-6db9-43e9-9305-8546304c51fe None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:09.341541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a7f8b2bb-6db9-43e9-9305-8546304c51fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:09.426438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc51d39-c17e-48ec-b0c6-a8f9ad7f2733 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:09.474685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5fd7e-ec04-4ee9-b46f-380d3d987784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:09.475384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5fd7e-ec04-4ee9-b46f-380d3d987784 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:09.475665 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5fd7e-ec04-4ee9-b46f-380d3d987784 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:09.475945 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5fd7e-ec04-4ee9-b46f-380d3d987784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:09.476791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5fd7e-ec04-4ee9-b46f-380d3d987784 None admin] RBAC: Adding query filter params (role.id=52bafac2651a4075879b7d97a4f9111e, scope.project.id=17128730ad3c43e194e508cc0fcd24cb, user.id=90fb781936154a33addfe7c9d4af6617) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:09.477150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5fd7e-ec04-4ee9-b46f-380d3d987784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:09.478693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5fd7e-ec04-4ee9-b46f-380d3d987784 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:09.485036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 78/165] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:09 2022] GET /identity/v3/role_assignments?user.id=90fb781936154a33addfe7c9d4af6617&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=52bafac2651a4075879b7d97a4f9111e => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:09.532503 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 88/166] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:09.589157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5fd7e-ec04-4ee9-b46f-380d3d987784 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:09.724113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5fd7e-ec04-4ee9-b46f-380d3d987784 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:09.759521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7511a-244f-4379-aca1-0ddffaa15522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:09.760346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7511a-244f-4379-aca1-0ddffaa15522 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:09.760625 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7511a-244f-4379-aca1-0ddffaa15522 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:09.760895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7511a-244f-4379-aca1-0ddffaa15522 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:09.771851 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7511a-244f-4379-aca1-0ddffaa15522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-9ad7511a-244f-4379-aca1-0ddffaa15522 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:09.780380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:09.781323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:09.782563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 79/167] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:09.789939 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8b2bb-6db9-43e9-9305-8546304c51fe None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:09.930298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8b2bb-6db9-43e9-9305-8546304c51fe None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:09.975922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40c2b6-ed70-4dae-9bcd-13b5aafc5a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:09.976825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40c2b6-ed70-4dae-9bcd-13b5aafc5a3d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:09.977265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40c2b6-ed70-4dae-9bcd-13b5aafc5a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:09.977682 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40c2b6-ed70-4dae-9bcd-13b5aafc5a3d None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:09.978671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40c2b6-ed70-4dae-9bcd-13b5aafc5a3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:09.979140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40c2b6-ed70-4dae-9bcd-13b5aafc5a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:09.980686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40c2b6-ed70-4dae-9bcd-13b5aafc5a3d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:10.001341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 89/168] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:10.006846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7511a-244f-4379-aca1-0ddffaa15522 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:10.164521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7511a-244f-4379-aca1-0ddffaa15522 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:10.201955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b11db9-3f2d-4e43-afc0-d4a5c0f2fd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:10.202841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11db9-3f2d-4e43-afc0-d4a5c0f2fd68 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:10.203147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11db9-3f2d-4e43-afc0-d4a5c0f2fd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:10.203435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11db9-3f2d-4e43-afc0-d4a5c0f2fd68 None admin] PATH_INFO: `/v3/users/90fb781936154a33addfe7c9d4af6617` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:10.204641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b11db9-3f2d-4e43-afc0-d4a5c0f2fd68 None admin] RBAC: Authorizing `identity:get_user(user_id=90fb781936154a33addfe7c9d4af6617)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:10.206652 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b11db9-3f2d-4e43-afc0-d4a5c0f2fd68 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:10.208627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 80/169] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:10 2022] GET /identity/v3/users/90fb781936154a33addfe7c9d4af6617 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:10.216225 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40c2b6-ed70-4dae-9bcd-13b5aafc5a3d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:10.373206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40c2b6-ed70-4dae-9bcd-13b5aafc5a3d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:10.416724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427edbf-d7c1-4e55-baab-bf690e85cd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:10.417660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427edbf-d7c1-4e55-baab-bf690e85cd43 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:10.418087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427edbf-d7c1-4e55-baab-bf690e85cd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:10.418508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427edbf-d7c1-4e55-baab-bf690e85cd43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:10.438783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6725b4a-c617-4643-8a26-64d1e9a08a1e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:10.439432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6725b4a-c617-4643-8a26-64d1e9a08a1e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:10.439910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6725b4a-c617-4643-8a26-64d1e9a08a1e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:10.442285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 81/170] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:10.447169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ecc29-311e-438b-a5ad-1de8e70cb0c6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:10.447714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ecc29-311e-438b-a5ad-1de8e70cb0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:10.448464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ecc29-311e-438b-a5ad-1de8e70cb0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:10.480245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-193ecc29-311e-438b-a5ad-1de8e70cb0c6 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:10.481793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-193ecc29-311e-438b-a5ad-1de8e70cb0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:10.524004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427edbf-d7c1-4e55-baab-bf690e85cd43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:10.525527 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427edbf-d7c1-4e55-baab-bf690e85cd43 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:10.575929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 82/171] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:10.610970 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ecc29-311e-438b-a5ad-1de8e70cb0c6 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:10.695795 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 90/172] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:10.704061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427edbf-d7c1-4e55-baab-bf690e85cd43 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:10.800582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ecc29-311e-438b-a5ad-1de8e70cb0c6 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:10.845307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed85b7-cc31-42c4-9d9f-9e6708fac6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:10.847016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed85b7-cc31-42c4-9d9f-9e6708fac6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:10.847523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed85b7-cc31-42c4-9d9f-9e6708fac6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:10.848012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed85b7-cc31-42c4-9d9f-9e6708fac6a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:10.858765 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed85b7-cc31-42c4-9d9f-9e6708fac6a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-5bed85b7-cc31-42c4-9d9f-9e6708fac6a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:10.867380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:10.868247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:10.869260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:10.871661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 83/173] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:10.880111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed85b7-cc31-42c4-9d9f-9e6708fac6a4 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:10.902000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427edbf-d7c1-4e55-baab-bf690e85cd43 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:10.977613 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2031628-b24e-4203-9691-ee1f063d438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:10.978864 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2031628-b24e-4203-9691-ee1f063d438d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:10.979403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2031628-b24e-4203-9691-ee1f063d438d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:10.979888 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2031628-b24e-4203-9691-ee1f063d438d None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:10.983076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2031628-b24e-4203-9691-ee1f063d438d None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:10.984969 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2031628-b24e-4203-9691-ee1f063d438d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:10.990609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 91/174] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:10 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:11.001256 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2031628-b24e-4203-9691-ee1f063d438d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:11.089831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed85b7-cc31-42c4-9d9f-9e6708fac6a4 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:11.158327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67db576-a9cd-400f-b3e2-6be2981487f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:11.159868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67db576-a9cd-400f-b3e2-6be2981487f1 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.160355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67db576-a9cd-400f-b3e2-6be2981487f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.160804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67db576-a9cd-400f-b3e2-6be2981487f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.161728 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67db576-a9cd-400f-b3e2-6be2981487f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:11.162206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67db576-a9cd-400f-b3e2-6be2981487f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:11.164784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67db576-a9cd-400f-b3e2-6be2981487f1 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:11.178817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 84/175] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:11.184622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2031628-b24e-4203-9691-ee1f063d438d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:11.185689 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67db576-a9cd-400f-b3e2-6be2981487f1 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:11.278801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023f520-507b-4136-9f1f-c9a2fda2cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:11.279428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023f520-507b-4136-9f1f-c9a2fda2cd29 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.279710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023f520-507b-4136-9f1f-c9a2fda2cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.279990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023f520-507b-4136-9f1f-c9a2fda2cd29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.280841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023f520-507b-4136-9f1f-c9a2fda2cd29 None admin] RBAC: Adding query filter params (role.id=1efabb1110d64eebacd85d9016d7d286, scope.project.id=17128730ad3c43e194e508cc0fcd24cb, user.id=90fb781936154a33addfe7c9d4af6617) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:11.281155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023f520-507b-4136-9f1f-c9a2fda2cd29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:11.282636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023f520-507b-4136-9f1f-c9a2fda2cd29 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:11.301426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67db576-a9cd-400f-b3e2-6be2981487f1 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:11.301997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 92/176] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:11 2022] GET /identity/v3/role_assignments?user.id=90fb781936154a33addfe7c9d4af6617&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=1efabb1110d64eebacd85d9016d7d286 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:11.307445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737132d6-5a0d-49f5-9033-4e1ac03d013e None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.307785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737132d6-5a0d-49f5-9033-4e1ac03d013e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.308074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737132d6-5a0d-49f5-9033-4e1ac03d013e None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.309570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 93/177] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:11.315364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9497cd-bf97-402a-9454-36cff616f9c1 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.315860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9497cd-bf97-402a-9454-36cff616f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.316284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9497cd-bf97-402a-9454-36cff616f9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.340209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-3a9497cd-bf97-402a-9454-36cff616f9c1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:11.341604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3a9497cd-bf97-402a-9454-36cff616f9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:11.349461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784a5b5-fa03-4bfb-af4e-d1a4503e1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:11.350361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784a5b5-fa03-4bfb-af4e-d1a4503e1f55 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.350644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784a5b5-fa03-4bfb-af4e-d1a4503e1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.350919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784a5b5-fa03-4bfb-af4e-d1a4503e1f55 None admin] PATH_INFO: `/v3/users/90fb781936154a33addfe7c9d4af6617` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.355981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784a5b5-fa03-4bfb-af4e-d1a4503e1f55 None admin] RBAC: Authorizing `identity:get_user(user_id=90fb781936154a33addfe7c9d4af6617)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:11.357511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784a5b5-fa03-4bfb-af4e-d1a4503e1f55 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:11.359575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 85/178] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:11 2022] GET /identity/v3/users/90fb781936154a33addfe7c9d4af6617 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:11.365602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784a5b5-fa03-4bfb-af4e-d1a4503e1f55 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:11.462987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 94/179] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:11.464423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b037cf-6910-40db-999b-08944a22aa35 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.464715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b037cf-6910-40db-999b-08944a22aa35 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.465001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b037cf-6910-40db-999b-08944a22aa35 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.466309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 95/180] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:11.471653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023718a-361c-4140-8bf0-88f4751555cf None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.471945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023718a-361c-4140-8bf0-88f4751555cf None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.472234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023718a-361c-4140-8bf0-88f4751555cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.489666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-4023718a-361c-4140-8bf0-88f4751555cf None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:11.490882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-4023718a-361c-4140-8bf0-88f4751555cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:11.508267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784a5b5-fa03-4bfb-af4e-d1a4503e1f55 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:11.542385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201c36c-8efa-42bf-87d7-508425c4fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:11.542961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c36c-8efa-42bf-87d7-508425c4fd80 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.543285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c36c-8efa-42bf-87d7-508425c4fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.543563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c36c-8efa-42bf-87d7-508425c4fd80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.560784 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 96/181] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:11.561440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023718a-361c-4140-8bf0-88f4751555cf None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:11.621057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201c36c-8efa-42bf-87d7-508425c4fd80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:11.622612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201c36c-8efa-42bf-87d7-508425c4fd80 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:11.695244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023718a-361c-4140-8bf0-88f4751555cf None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:11.725822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 86/182] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 17:07:11.731105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201c36c-8efa-42bf-87d7-508425c4fd80 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:11.732544 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78b695-d1a6-4ab4-bae6-ed0f759d15fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:11.733361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78b695-d1a6-4ab4-bae6-ed0f759d15fa None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.733649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78b695-d1a6-4ab4-bae6-ed0f759d15fa None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.733928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78b695-d1a6-4ab4-bae6-ed0f759d15fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.745151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78b695-d1a6-4ab4-bae6-ed0f759d15fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-ad78b695-d1a6-4ab4-bae6-ed0f759d15fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:11.753630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:11.754557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 97/183] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:07:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:11.756815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78b695-d1a6-4ab4-bae6-ed0f759d15fa None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:11.835295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201c36c-8efa-42bf-87d7-508425c4fd80 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:11.865525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78b695-d1a6-4ab4-bae6-ed0f759d15fa None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:11.872672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dbeda-e238-4089-ab56-f0c0bf683e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:11.873371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dbeda-e238-4089-ab56-f0c0bf683e40 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.873612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dbeda-e238-4089-ab56-f0c0bf683e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.873887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dbeda-e238-4089-ab56-f0c0bf683e40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.885522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dbeda-e238-4089-ab56-f0c0bf683e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d62dbeda-e238-4089-ab56-f0c0bf683e40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:11.894078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:11.895009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:11.895829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 87/184] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:11.899960 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab09c-edbf-4986-b798-a7cd27c2aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:11.900079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dbeda-e238-4089-ab56-f0c0bf683e40 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:11.901002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab09c-edbf-4986-b798-a7cd27c2aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.901403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab09c-edbf-4986-b798-a7cd27c2aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.901695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab09c-edbf-4986-b798-a7cd27c2aaa7 None admin] PATH_INFO: `/v3/projects/d2b0c1935ce64c42941dd272713e4a00` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.902878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ab09c-edbf-4986-b798-a7cd27c2aaa7 None admin] RBAC: Authorizing `identity:get_project(project_id=d2b0c1935ce64c42941dd272713e4a00)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:11.904407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ab09c-edbf-4986-b798-a7cd27c2aaa7 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:11.906275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 98/185] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:11 2022] GET /identity/v3/projects/d2b0c1935ce64c42941dd272713e4a00 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:11.907370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a941d01-0caf-415d-bcc6-670115fb8e50 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.907659 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a941d01-0caf-415d-bcc6-670115fb8e50 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.907936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a941d01-0caf-415d-bcc6-670115fb8e50 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.909715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 99/186] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:11.910790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5e8c9-578a-467d-a3ab-07b5de8ebf7e None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:11.911102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5e8c9-578a-467d-a3ab-07b5de8ebf7e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:11.911499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5e8c9-578a-467d-a3ab-07b5de8ebf7e None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:11.915173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 100/187] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:11.915173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5e8c9-578a-467d-a3ab-07b5de8ebf7e None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:11.998663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dbeda-e238-4089-ab56-f0c0bf683e40 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:12.010116 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5e8c9-578a-467d-a3ab-07b5de8ebf7e None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:12.029904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102c448-479a-4793-b610-e692605e17f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:12.030591 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102c448-479a-4793-b610-e692605e17f2 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.030870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102c448-479a-4793-b610-e692605e17f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.031161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102c448-479a-4793-b610-e692605e17f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.031952 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102c448-479a-4793-b610-e692605e17f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:12.032254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102c448-479a-4793-b610-e692605e17f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:12.033647 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102c448-479a-4793-b610-e692605e17f2 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:12.041853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf98d91-cffa-4ff4-b406-3df0efb04664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:12.041977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 88/188] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:12.042519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf98d91-cffa-4ff4-b406-3df0efb04664 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.042803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf98d91-cffa-4ff4-b406-3df0efb04664 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.043078 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf98d91-cffa-4ff4-b406-3df0efb04664 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.043290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5e3ac-31ad-4ecf-af03-8f356e82fe38 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.043574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5e3ac-31ad-4ecf-af03-8f356e82fe38 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.043847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5e3ac-31ad-4ecf-af03-8f356e82fe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.043946 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf98d91-cffa-4ff4-b406-3df0efb04664 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:12.044151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf98d91-cffa-4ff4-b406-3df0efb04664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:12.045533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf98d91-cffa-4ff4-b406-3df0efb04664 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:12.054247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 101/189] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:12.055023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf98d91-cffa-4ff4-b406-3df0efb04664 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:12.068191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-93e5e3ac-31ad-4ecf-af03-8f356e82fe38 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:12.069370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-93e5e3ac-31ad-4ecf-af03-8f356e82fe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:12.130659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 89/190] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:12.132009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e1bde-26d9-462e-b64d-e189078b1375 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.132299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e1bde-26d9-462e-b64d-e189078b1375 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.132618 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e1bde-26d9-462e-b64d-e189078b1375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.149206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf98d91-cffa-4ff4-b406-3df0efb04664 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:12.149348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-805e1bde-26d9-462e-b64d-e189078b1375 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:12.150483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-805e1bde-26d9-462e-b64d-e189078b1375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:12.182324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f17bde-3887-4af6-86de-1e1a8c49f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:12.182988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f17bde-3887-4af6-86de-1e1a8c49f157 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.183304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f17bde-3887-4af6-86de-1e1a8c49f157 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.183583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f17bde-3887-4af6-86de-1e1a8c49f157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.184421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f17bde-3887-4af6-86de-1e1a8c49f157 None admin] RBAC: Adding query filter params (role.id=52bafac2651a4075879b7d97a4f9111e, scope.project.id=d2b0c1935ce64c42941dd272713e4a00, user.id=90fb781936154a33addfe7c9d4af6617) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:12.184734 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f17bde-3887-4af6-86de-1e1a8c49f157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:12.186186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f17bde-3887-4af6-86de-1e1a8c49f157 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:12.191823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 102/191] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:12 2022] GET /identity/v3/role_assignments?user.id=90fb781936154a33addfe7c9d4af6617&scope.project.id=d2b0c1935ce64c42941dd272713e4a00&role.id=52bafac2651a4075879b7d97a4f9111e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:12.192595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f17bde-3887-4af6-86de-1e1a8c49f157 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:12.216575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 90/192] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:12.219358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e1bde-26d9-462e-b64d-e189078b1375 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:12.307521 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f17bde-3887-4af6-86de-1e1a8c49f157 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:12.334682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e1bde-26d9-462e-b64d-e189078b1375 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:12.342174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68782057-eabe-47f4-952a-100d59314ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:12.343076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782057-eabe-47f4-952a-100d59314ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.343405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782057-eabe-47f4-952a-100d59314ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.343684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782057-eabe-47f4-952a-100d59314ea3 None admin] PATH_INFO: `/v3/users/82614fb4ae254b1da884c46d41c06628` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.358346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68782057-eabe-47f4-952a-100d59314ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=82614fb4ae254b1da884c46d41c06628)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:12.359975 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68782057-eabe-47f4-952a-100d59314ea3 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:12.361815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 103/193] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:12 2022] GET /identity/v3/users/82614fb4ae254b1da884c46d41c06628 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:12.366910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68782057-eabe-47f4-952a-100d59314ea3 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:12.378439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cde728-e142-475c-80ad-102b767d8a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:12.379368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cde728-e142-475c-80ad-102b767d8a8f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.379740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cde728-e142-475c-80ad-102b767d8a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.380016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cde728-e142-475c-80ad-102b767d8a8f None admin] PATH_INFO: `/v3/users/82614fb4ae254b1da884c46d41c06628` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.382015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cde728-e142-475c-80ad-102b767d8a8f None admin] RBAC: Authorizing `identity:get_user(user_id=82614fb4ae254b1da884c46d41c06628)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:12.384556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cde728-e142-475c-80ad-102b767d8a8f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:12.387782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 91/194] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:12 2022] GET /identity/v3/users/82614fb4ae254b1da884c46d41c06628 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:12.388072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cde728-e142-475c-80ad-102b767d8a8f None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:12.478358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68782057-eabe-47f4-952a-100d59314ea3 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:12.490666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cde728-e142-475c-80ad-102b767d8a8f None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:12.512859 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd229a-ab8c-4087-b383-b587c0b1f557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:12.513641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd229a-ab8c-4087-b383-b587c0b1f557 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.513921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd229a-ab8c-4087-b383-b587c0b1f557 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.514195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd229a-ab8c-4087-b383-b587c0b1f557 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.515374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd229a-ab8c-4087-b383-b587c0b1f557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:12.516832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd229a-ab8c-4087-b383-b587c0b1f557 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:12.518457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 104/195] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:12.519221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd229a-ab8c-4087-b383-b587c0b1f557 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:12.525855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700eba1-f818-4657-8feb-c3f21c413817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:12.526674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700eba1-f818-4657-8feb-c3f21c413817 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.526954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700eba1-f818-4657-8feb-c3f21c413817 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.527251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700eba1-f818-4657-8feb-c3f21c413817 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.537111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700eba1-f818-4657-8feb-c3f21c413817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-8700eba1-f818-4657-8feb-c3f21c413817 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:12.544755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:12.545713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:12.546511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 92/196] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:12.547183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700eba1-f818-4657-8feb-c3f21c413817 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:12.617540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd229a-ab8c-4087-b383-b587c0b1f557 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:12.641984 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700eba1-f818-4657-8feb-c3f21c413817 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:12.648952 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd074de8-e729-4a51-93dd-51460ea80bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:12.649592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd074de8-e729-4a51-93dd-51460ea80bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.649871 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd074de8-e729-4a51-93dd-51460ea80bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.650148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd074de8-e729-4a51-93dd-51460ea80bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.673227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed37db7-4849-44c9-8ce3-0afb1a2a9636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:12.673864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed37db7-4849-44c9-8ce3-0afb1a2a9636 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.674140 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed37db7-4849-44c9-8ce3-0afb1a2a9636 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.674412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed37db7-4849-44c9-8ce3-0afb1a2a9636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.712113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd074de8-e729-4a51-93dd-51460ea80bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:12.713584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd074de8-e729-4a51-93dd-51460ea80bc9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:12.737625 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed37db7-4849-44c9-8ce3-0afb1a2a9636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:12.739097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed37db7-4849-44c9-8ce3-0afb1a2a9636 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:12.804030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 105/197] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:12.808635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd074de8-e729-4a51-93dd-51460ea80bc9 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:12.830110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 93/198] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:12.831045 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed37db7-4849-44c9-8ce3-0afb1a2a9636 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:12.895164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd074de8-e729-4a51-93dd-51460ea80bc9 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:12.922188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed37db7-4849-44c9-8ce3-0afb1a2a9636 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:12.927207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd525e-b825-4102-b68d-559e979fbb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:12.927864 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd525e-b825-4102-b68d-559e979fbb4b None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.928143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd525e-b825-4102-b68d-559e979fbb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.928413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd525e-b825-4102-b68d-559e979fbb4b None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.929108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd525e-b825-4102-b68d-559e979fbb4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:12.930562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd525e-b825-4102-b68d-559e979fbb4b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:12.954613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6e87c-d6fd-4434-b49b-23cf3dd280f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:12.962119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e87c-d6fd-4434-b49b-23cf3dd280f1 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:12.962119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e87c-d6fd-4434-b49b-23cf3dd280f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:12.962119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e87c-d6fd-4434-b49b-23cf3dd280f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:12.962119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6e87c-d6fd-4434-b49b-23cf3dd280f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:12.962119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6e87c-d6fd-4434-b49b-23cf3dd280f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:12.962119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6e87c-d6fd-4434-b49b-23cf3dd280f1 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:12.966041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 94/199] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:12.966823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6e87c-d6fd-4434-b49b-23cf3dd280f1 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:13.026909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 106/200] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:07:12 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:07:13.027895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd525e-b825-4102-b68d-559e979fbb4b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:13.066659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6e87c-d6fd-4434-b49b-23cf3dd280f1 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:13.102772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8f48-070c-4f05-8395-21773f177bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:13.103845 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8f48-070c-4f05-8395-21773f177bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:13.103975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8f48-070c-4f05-8395-21773f177bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:13.104234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8f48-070c-4f05-8395-21773f177bf8 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:13.105520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b8f48-070c-4f05-8395-21773f177bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:13.107041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b8f48-070c-4f05-8395-21773f177bf8 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:13.109073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 95/201] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:12 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:13.109691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8f48-070c-4f05-8395-21773f177bf8 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:13.134797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd525e-b825-4102-b68d-559e979fbb4b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:13.171512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6596f8-78ba-463c-addc-f47d73a62cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:13.172652 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6596f8-78ba-463c-addc-f47d73a62cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:13.172934 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6596f8-78ba-463c-addc-f47d73a62cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:13.173212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6596f8-78ba-463c-addc-f47d73a62cd4 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:13.174498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6596f8-78ba-463c-addc-f47d73a62cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:13.176020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6596f8-78ba-463c-addc-f47d73a62cd4 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:13.177931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 107/202] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:13 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:13.178619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6596f8-78ba-463c-addc-f47d73a62cd4 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:13.218698 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8f48-070c-4f05-8395-21773f177bf8 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:13.256616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176f1d7-200c-42a0-a452-39f3767b94af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:13.257532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176f1d7-200c-42a0-a452-39f3767b94af None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:13.257791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176f1d7-200c-42a0-a452-39f3767b94af None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:13.258064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176f1d7-200c-42a0-a452-39f3767b94af None admin] PATH_INFO: `/v3/users/36a807b86d1d467ba22ca3081bd051e8` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:13.259328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176f1d7-200c-42a0-a452-39f3767b94af None admin] RBAC: Authorizing `identity:get_user(user_id=36a807b86d1d467ba22ca3081bd051e8)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:13.260818 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176f1d7-200c-42a0-a452-39f3767b94af None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:13.264567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 96/203] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:13 2022] GET /identity/v3/users/36a807b86d1d467ba22ca3081bd051e8 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:13.264567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176f1d7-200c-42a0-a452-39f3767b94af None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:13.278088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6596f8-78ba-463c-addc-f47d73a62cd4 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:13.316864 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a8db5-fe57-41db-87d3-0a3e2e92b0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:13.317915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8db5-fe57-41db-87d3-0a3e2e92b0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:13.318201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8db5-fe57-41db-87d3-0a3e2e92b0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:13.318477 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8db5-fe57-41db-87d3-0a3e2e92b0d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:13.319512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a8db5-fe57-41db-87d3-0a3e2e92b0d9 None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4, user.id=82614fb4ae254b1da884c46d41c06628) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:13.319828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a8db5-fe57-41db-87d3-0a3e2e92b0d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:13.321378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a8db5-fe57-41db-87d3-0a3e2e92b0d9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:13.327878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 108/204] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:13 2022] GET /identity/v3/role_assignments?user.id=82614fb4ae254b1da884c46d41c06628&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=2791519d9bad43318f086666b6e64a20 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:13.328559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a8db5-fe57-41db-87d3-0a3e2e92b0d9 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:13.366927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176f1d7-200c-42a0-a452-39f3767b94af None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:13.410128 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64a108-0d40-4cc1-a327-0dea62f670bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:13.410809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64a108-0d40-4cc1-a327-0dea62f670bb None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:13.411088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64a108-0d40-4cc1-a327-0dea62f670bb None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:13.411385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64a108-0d40-4cc1-a327-0dea62f670bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:13.412245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64a108-0d40-4cc1-a327-0dea62f670bb None admin] RBAC: Adding query filter params (role.id=1efabb1110d64eebacd85d9016d7d286, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4, user.id=82614fb4ae254b1da884c46d41c06628) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:13.412550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64a108-0d40-4cc1-a327-0dea62f670bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:13.414063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64a108-0d40-4cc1-a327-0dea62f670bb None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:13.420564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 97/205] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:13 2022] GET /identity/v3/role_assignments?user.id=82614fb4ae254b1da884c46d41c06628&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=1efabb1110d64eebacd85d9016d7d286 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:13.452340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a8db5-fe57-41db-87d3-0a3e2e92b0d9 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:13.493172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a7ba1-475d-45f3-a1af-efc4ce753e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:13.493854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a7ba1-475d-45f3-a1af-efc4ce753e58 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:13.494142 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a7ba1-475d-45f3-a1af-efc4ce753e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:13.494419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a7ba1-475d-45f3-a1af-efc4ce753e58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:13.573447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a7ba1-475d-45f3-a1af-efc4ce753e58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:13.574976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a7ba1-475d-45f3-a1af-efc4ce753e58 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:13.680944 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 109/206] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:13.692287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64a108-0d40-4cc1-a327-0dea62f670bb None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:13.840112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64a108-0d40-4cc1-a327-0dea62f670bb None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:13.887833 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c7aab-eb2d-4911-b8b9-17e9de020a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:13.889060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c7aab-eb2d-4911-b8b9-17e9de020a10 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:13.889558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c7aab-eb2d-4911-b8b9-17e9de020a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:13.890022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c7aab-eb2d-4911-b8b9-17e9de020a10 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:13.891444 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c7aab-eb2d-4911-b8b9-17e9de020a10 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:13.893116 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c7aab-eb2d-4911-b8b9-17e9de020a10 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:13.895043 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 98/207] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:13 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:13.900693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a7ba1-475d-45f3-a1af-efc4ce753e58 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:14.018990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a7ba1-475d-45f3-a1af-efc4ce753e58 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:14.058757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c05f89-37de-4e96-9f4e-e8b0f66bdd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:14.059457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c05f89-37de-4e96-9f4e-e8b0f66bdd41 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:14.059745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c05f89-37de-4e96-9f4e-e8b0f66bdd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:14.060071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c05f89-37de-4e96-9f4e-e8b0f66bdd41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:14.060931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c05f89-37de-4e96-9f4e-e8b0f66bdd41 None admin] RBAC: Adding query filter params (role.id=857d25aa9bd04e0b90ba9a17aba49c51, scope.project.id=17128730ad3c43e194e508cc0fcd24cb, user.id=36a807b86d1d467ba22ca3081bd051e8) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:14.061247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c05f89-37de-4e96-9f4e-e8b0f66bdd41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:14.062958 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c05f89-37de-4e96-9f4e-e8b0f66bdd41 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:14.070191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 110/208] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:13 2022] GET /identity/v3/role_assignments?user.id=36a807b86d1d467ba22ca3081bd051e8&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=857d25aa9bd04e0b90ba9a17aba49c51 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:15.580279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e7bf-4e2d-45c4-a0fd-9a1e220952c2 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:15.581834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e7bf-4e2d-45c4-a0fd-9a1e220952c2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:15.582313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e7bf-4e2d-45c4-a0fd-9a1e220952c2 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:15.583937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 99/209] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:15.589889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f204399-d81b-4c3b-97ae-d74ea728a87f None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:15.591307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f204399-d81b-4c3b-97ae-d74ea728a87f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:15.592139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f204399-d81b-4c3b-97ae-d74ea728a87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:15.610767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-5f204399-d81b-4c3b-97ae-d74ea728a87f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:15.612341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-5f204399-d81b-4c3b-97ae-d74ea728a87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:15.664798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c140d55-ed88-473e-8f65-1a00e1855de8 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:15.665420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c140d55-ed88-473e-8f65-1a00e1855de8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:15.666076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c140d55-ed88-473e-8f65-1a00e1855de8 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:15.668154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 100/210] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:15.676480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c74a7-db2e-4772-a529-6885a48a8425 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:15.677370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c74a7-db2e-4772-a529-6885a48a8425 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:15.677871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c74a7-db2e-4772-a529-6885a48a8425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:15.687233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 111/211] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:15.697610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-339c74a7-db2e-4772-a529-6885a48a8425 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:15.699346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-339c74a7-db2e-4772-a529-6885a48a8425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:15.714918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f204399-d81b-4c3b-97ae-d74ea728a87f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:15.784411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 101/212] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:15.809214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c74a7-db2e-4772-a529-6885a48a8425 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:15.825753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f204399-d81b-4c3b-97ae-d74ea728a87f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:15.860383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15869cbc-67ee-4aa7-b449-e9a3d49c3b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:15.861106 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869cbc-67ee-4aa7-b449-e9a3d49c3b7f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:15.861391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869cbc-67ee-4aa7-b449-e9a3d49c3b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:15.861668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869cbc-67ee-4aa7-b449-e9a3d49c3b7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:15.871863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15869cbc-67ee-4aa7-b449-e9a3d49c3b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-15869cbc-67ee-4aa7-b449-e9a3d49c3b7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:15.880180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:15.881050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:15.881828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 112/213] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:15.882985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7c7a1-af6a-4ac6-adfe-993274942dcf None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:15.882985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7c7a1-af6a-4ac6-adfe-993274942dcf None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:15.883157 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7c7a1-af6a-4ac6-adfe-993274942dcf None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:15.884585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 113/214] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:15.886988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7c7a1-af6a-4ac6-adfe-993274942dcf None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:15.923604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c74a7-db2e-4772-a529-6885a48a8425 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:15.959290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e5dab-1c4e-4595-937d-8724fc40e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:15.960092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5dab-1c4e-4595-937d-8724fc40e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:15.960370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5dab-1c4e-4595-937d-8724fc40e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:15.960641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5dab-1c4e-4595-937d-8724fc40e9f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:15.961808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e5dab-1c4e-4595-937d-8724fc40e9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:15.963307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e5dab-1c4e-4595-937d-8724fc40e9f4 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:15.964923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 102/215] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:15.966132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abb90-0672-4820-9437-c0afa6fbd3ed None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:15.966418 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abb90-0672-4820-9437-c0afa6fbd3ed None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:15.966689 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abb90-0672-4820-9437-c0afa6fbd3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:15.982551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b68abb90-0672-4820-9437-c0afa6fbd3ed None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:15.983757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b68abb90-0672-4820-9437-c0afa6fbd3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:15.988470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7c7a1-af6a-4ac6-adfe-993274942dcf None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:16.020931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f8e80-0ad0-4aec-b622-17b7677ba64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:16.021594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8e80-0ad0-4aec-b622-17b7677ba64b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.021879 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8e80-0ad0-4aec-b622-17b7677ba64b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.022153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8e80-0ad0-4aec-b622-17b7677ba64b None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.022901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f8e80-0ad0-4aec-b622-17b7677ba64b None admin] RBAC: Adding query filter params (name=member) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:16.023237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f8e80-0ad0-4aec-b622-17b7677ba64b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:16.024650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f8e80-0ad0-4aec-b622-17b7677ba64b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:16.032828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 114/216] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:16.034226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7332f-674d-4845-b5a6-8d151a95faf1 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.034522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7332f-674d-4845-b5a6-8d151a95faf1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.034796 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7332f-674d-4845-b5a6-8d151a95faf1 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.036075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 115/217] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:16.036754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7332f-674d-4845-b5a6-8d151a95faf1 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:16.052316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 103/218] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:16.057403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abb90-0672-4820-9437-c0afa6fbd3ed None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:16.133944 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7332f-674d-4845-b5a6-8d151a95faf1 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:16.149052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abb90-0672-4820-9437-c0afa6fbd3ed None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:16.165323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e5471-cdc1-42e6-9707-1ecef8990d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:16.165986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5471-cdc1-42e6-9707-1ecef8990d0e None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.166270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5471-cdc1-42e6-9707-1ecef8990d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.166547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5471-cdc1-42e6-9707-1ecef8990d0e None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.167280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e5471-cdc1-42e6-9707-1ecef8990d0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:16.168753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e5471-cdc1-42e6-9707-1ecef8990d0e None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:16.180868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc152d3-37eb-4310-a450-9fa60791ff89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:16.181794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc152d3-37eb-4310-a450-9fa60791ff89 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.182129 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc152d3-37eb-4310-a450-9fa60791ff89 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.182398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc152d3-37eb-4310-a450-9fa60791ff89 None admin] PATH_INFO: `/v3/users/9913c50c5ca54208b737b15dfddde887` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.195786 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc152d3-37eb-4310-a450-9fa60791ff89 None admin] RBAC: Authorizing `identity:get_user(user_id=9913c50c5ca54208b737b15dfddde887)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:16.197259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc152d3-37eb-4310-a450-9fa60791ff89 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:16.199186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 104/219] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:16 2022] GET /identity/v3/users/9913c50c5ca54208b737b15dfddde887 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:16.200381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8fcd1-75b9-44f2-abdc-b2d5191a36ab None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.200674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8fcd1-75b9-44f2-abdc-b2d5191a36ab None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.200939 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8fcd1-75b9-44f2-abdc-b2d5191a36ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.216154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-59e8fcd1-75b9-44f2-abdc-b2d5191a36ab None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:16.217332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-59e8fcd1-75b9-44f2-abdc-b2d5191a36ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:16.261228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 116/220] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:07:16 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:07:16.262053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e5471-cdc1-42e6-9707-1ecef8990d0e None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:16.283725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 105/221] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:16.292733 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8fcd1-75b9-44f2-abdc-b2d5191a36ab None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:16.367361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e5471-cdc1-42e6-9707-1ecef8990d0e None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:16.401101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8fcd1-75b9-44f2-abdc-b2d5191a36ab None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:16.405050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c43d9-1cd9-4c3d-aa8b-51e2bc22c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:16.405895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c43d9-1cd9-4c3d-aa8b-51e2bc22c0ed None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.406178 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c43d9-1cd9-4c3d-aa8b-51e2bc22c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.406452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c43d9-1cd9-4c3d-aa8b-51e2bc22c0ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.417623 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c43d9-1cd9-4c3d-aa8b-51e2bc22c0ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-e33c43d9-1cd9-4c3d-aa8b-51e2bc22c0ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:16.426525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:16.427560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 117/222] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:16.433870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c43d9-1cd9-4c3d-aa8b-51e2bc22c0ed None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:16.443880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505774b-8303-40d4-b3ab-536bcbcfc022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:16.445335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505774b-8303-40d4-b3ab-536bcbcfc022 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.445959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505774b-8303-40d4-b3ab-536bcbcfc022 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.446414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505774b-8303-40d4-b3ab-536bcbcfc022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.525971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505774b-8303-40d4-b3ab-536bcbcfc022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:16.527512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505774b-8303-40d4-b3ab-536bcbcfc022 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:16.540134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c43d9-1cd9-4c3d-aa8b-51e2bc22c0ed None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:16.576481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9a0a-a755-4eef-b28d-560ad2ec2f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:16.577825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9a0a-a755-4eef-b28d-560ad2ec2f3d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.578319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9a0a-a755-4eef-b28d-560ad2ec2f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.578827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9a0a-a755-4eef-b28d-560ad2ec2f3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.589814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc9a0a-a755-4eef-b28d-560ad2ec2f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-3cdc9a0a-a755-4eef-b28d-560ad2ec2f3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:16.598333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:16.599928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 118/223] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:07:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:16.600762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9a0a-a755-4eef-b28d-560ad2ec2f3d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:16.652193 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 106/224] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:16.653039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505774b-8303-40d4-b3ab-536bcbcfc022 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:16.708344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9a0a-a755-4eef-b28d-560ad2ec2f3d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:16.742678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacec2c-ff9f-401c-afd7-d08a10f4e790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:16.743434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacec2c-ff9f-401c-afd7-d08a10f4e790 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.743716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacec2c-ff9f-401c-afd7-d08a10f4e790 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.744047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacec2c-ff9f-401c-afd7-d08a10f4e790 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.744802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacec2c-ff9f-401c-afd7-d08a10f4e790 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:16.745107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacec2c-ff9f-401c-afd7-d08a10f4e790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:16.746570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacec2c-ff9f-401c-afd7-d08a10f4e790 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:16.752930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505774b-8303-40d4-b3ab-536bcbcfc022 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:16.754759 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 119/225] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:16.755586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacec2c-ff9f-401c-afd7-d08a10f4e790 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:16.793615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a4f4f-b784-4983-bdef-078a7e0e3cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:16.794295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a4f4f-b784-4983-bdef-078a7e0e3cff None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.794575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a4f4f-b784-4983-bdef-078a7e0e3cff None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.794847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a4f4f-b784-4983-bdef-078a7e0e3cff None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.795650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a4f4f-b784-4983-bdef-078a7e0e3cff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:16.795955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a4f4f-b784-4983-bdef-078a7e0e3cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:16.797388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a4f4f-b784-4983-bdef-078a7e0e3cff None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:16.806018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 107/226] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:16.806855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a4f4f-b784-4983-bdef-078a7e0e3cff None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:16.863319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacec2c-ff9f-401c-afd7-d08a10f4e790 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:16.897559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c17b4e-0fbc-490e-9cdb-9ca70dcdeb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:16.898472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17b4e-0fbc-490e-9cdb-9ca70dcdeb76 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.898754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17b4e-0fbc-490e-9cdb-9ca70dcdeb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.899027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17b4e-0fbc-490e-9cdb-9ca70dcdeb76 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.900480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c17b4e-0fbc-490e-9cdb-9ca70dcdeb76 None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:16.902002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c17b4e-0fbc-490e-9cdb-9ca70dcdeb76 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:16.903839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 120/227] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:16 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:16.904608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c17b4e-0fbc-490e-9cdb-9ca70dcdeb76 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:16.908258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a4f4f-b784-4983-bdef-078a7e0e3cff None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:16.942758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99252592-2466-457e-a0a3-9492f25fafb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:16.943678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99252592-2466-457e-a0a3-9492f25fafb5 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:16.943958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99252592-2466-457e-a0a3-9492f25fafb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:16.944234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99252592-2466-457e-a0a3-9492f25fafb5 None admin] PATH_INFO: `/v3/users/82614fb4ae254b1da884c46d41c06628` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:16.945437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99252592-2466-457e-a0a3-9492f25fafb5 None admin] RBAC: Authorizing `identity:get_user(user_id=82614fb4ae254b1da884c46d41c06628)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:16.946914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99252592-2466-457e-a0a3-9492f25fafb5 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:16.953013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 108/228] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:16 2022] GET /identity/v3/users/82614fb4ae254b1da884c46d41c06628 => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:16.953910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99252592-2466-457e-a0a3-9492f25fafb5 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:17.006556 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c17b4e-0fbc-490e-9cdb-9ca70dcdeb76 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:17.039692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a9a0-0dea-47d5-a659-42090f9b4ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:17.040567 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a9a0-0dea-47d5-a659-42090f9b4ece None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:17.040847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a9a0-0dea-47d5-a659-42090f9b4ece None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:17.041118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a9a0-0dea-47d5-a659-42090f9b4ece None admin] PATH_INFO: `/v3/users/82614fb4ae254b1da884c46d41c06628` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:17.042305 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5a9a0-0dea-47d5-a659-42090f9b4ece None admin] RBAC: Authorizing `identity:get_user(user_id=82614fb4ae254b1da884c46d41c06628)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:17.043786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5a9a0-0dea-47d5-a659-42090f9b4ece None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:17.051645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 121/229] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:16 2022] GET /identity/v3/users/82614fb4ae254b1da884c46d41c06628 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:17.051645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a9a0-0dea-47d5-a659-42090f9b4ece None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:17.061192 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99252592-2466-457e-a0a3-9492f25fafb5 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:17.096337 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87051bac-e8ca-48ce-8fed-957cae230edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:17.097110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051bac-e8ca-48ce-8fed-957cae230edf None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:17.097459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051bac-e8ca-48ce-8fed-957cae230edf None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:17.097804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051bac-e8ca-48ce-8fed-957cae230edf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:17.098756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87051bac-e8ca-48ce-8fed-957cae230edf None admin] RBAC: Adding query filter params (role.id=52bafac2651a4075879b7d97a4f9111e, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4, user.id=9913c50c5ca54208b737b15dfddde887) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:17.099175 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87051bac-e8ca-48ce-8fed-957cae230edf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:17.100718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87051bac-e8ca-48ce-8fed-957cae230edf None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:17.106774 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 109/230] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:16 2022] GET /identity/v3/role_assignments?user.id=9913c50c5ca54208b737b15dfddde887&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=52bafac2651a4075879b7d97a4f9111e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:17.107724 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87051bac-e8ca-48ce-8fed-957cae230edf None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:17.149793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a9a0-0dea-47d5-a659-42090f9b4ece None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:17.190567 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d705-d721-4fc1-929e-9923f33206ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:17.191722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d705-d721-4fc1-929e-9923f33206ba None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:17.192009 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d705-d721-4fc1-929e-9923f33206ba None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:17.193408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d705-d721-4fc1-929e-9923f33206ba None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:17.193594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0d705-d721-4fc1-929e-9923f33206ba None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:17.196073 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0d705-d721-4fc1-929e-9923f33206ba None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:17.199012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 122/231] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:17 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:17.204774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d705-d721-4fc1-929e-9923f33206ba None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:17.215031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87051bac-e8ca-48ce-8fed-957cae230edf None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:17.250181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc564a6-c97e-4c53-851a-4dfe376a41dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:17.251082 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc564a6-c97e-4c53-851a-4dfe376a41dd None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:17.251385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc564a6-c97e-4c53-851a-4dfe376a41dd None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:17.251660 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc564a6-c97e-4c53-851a-4dfe376a41dd None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:17.253026 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc564a6-c97e-4c53-851a-4dfe376a41dd None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:17.254550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc564a6-c97e-4c53-851a-4dfe376a41dd None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:17.256860 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 110/232] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:17 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:17.265616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc564a6-c97e-4c53-851a-4dfe376a41dd None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:17.363315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d705-d721-4fc1-929e-9923f33206ba None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:17.405572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354ee7a-63cd-4bf0-97b4-24368f8e7321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:17.406994 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354ee7a-63cd-4bf0-97b4-24368f8e7321 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:17.407511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354ee7a-63cd-4bf0-97b4-24368f8e7321 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:17.408441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354ee7a-63cd-4bf0-97b4-24368f8e7321 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/users/82614fb4ae254b1da884c46d41c06628/roles/1efabb1110d64eebacd85d9016d7d286` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:17.414707 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354ee7a-63cd-4bf0-97b4-24368f8e7321 None admin] RBAC: Authorizing `identity:create_grant(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4, user_id=82614fb4ae254b1da884c46d41c06628, role_id=1efabb1110d64eebacd85d9016d7d286)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:17.416412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354ee7a-63cd-4bf0-97b4-24368f8e7321 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:17.445145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc564a6-c97e-4c53-851a-4dfe376a41dd None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:17.479495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873effda-2cce-465b-89dc-ff1d81750df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:17.480463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873effda-2cce-465b-89dc-ff1d81750df2 None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:17.480738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873effda-2cce-465b-89dc-ff1d81750df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:17.481006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873effda-2cce-465b-89dc-ff1d81750df2 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/users/82614fb4ae254b1da884c46d41c06628/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:17.483205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873effda-2cce-465b-89dc-ff1d81750df2 None admin] RBAC: Authorizing `identity:create_grant(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4, user_id=82614fb4ae254b1da884c46d41c06628, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:17.484722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873effda-2cce-465b-89dc-ff1d81750df2 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:17.502746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 123/233] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:07:17 2022] PUT /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/users/82614fb4ae254b1da884c46d41c06628/roles/1efabb1110d64eebacd85d9016d7d286 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:17.579793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 111/234] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:07:17 2022] PUT /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/users/82614fb4ae254b1da884c46d41c06628/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:18.947984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504caf0-beb1-4009-bae5-3183cea06cad None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:18.948765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504caf0-beb1-4009-bae5-3183cea06cad None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:18.948840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504caf0-beb1-4009-bae5-3183cea06cad None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:18.950345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 124/235] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:18.955406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832f689-f4a7-4b3a-b75a-0ddd0f853267 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:18.955897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832f689-f4a7-4b3a-b75a-0ddd0f853267 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:18.956081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832f689-f4a7-4b3a-b75a-0ddd0f853267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:18.976302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9832f689-f4a7-4b3a-b75a-0ddd0f853267 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:18.977543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9832f689-f4a7-4b3a-b75a-0ddd0f853267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:19.067736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 112/236] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:19.069137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b821874-4a9b-4367-9fea-218a09247492 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:19.069400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b821874-4a9b-4367-9fea-218a09247492 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:19.069679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b821874-4a9b-4367-9fea-218a09247492 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:19.071220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 125/237] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:19.077055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8226d0-2c99-44d4-acad-3dbf3fda5fce None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:19.077350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8226d0-2c99-44d4-acad-3dbf3fda5fce None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:19.077629 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8226d0-2c99-44d4-acad-3dbf3fda5fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:19.101392 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5f8226d0-2c99-44d4-acad-3dbf3fda5fce None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:19.102891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5f8226d0-2c99-44d4-acad-3dbf3fda5fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:19.113004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b821874-4a9b-4367-9fea-218a09247492 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:19.227326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 113/238] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:19.246606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8226d0-2c99-44d4-acad-3dbf3fda5fce None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:19.336789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b821874-4a9b-4367-9fea-218a09247492 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:19.347022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8226d0-2c99-44d4-acad-3dbf3fda5fce None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:19.382016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f186-82f6-4e3a-923f-8978d50970aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:19.383043 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f186-82f6-4e3a-923f-8978d50970aa None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:19.383508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f186-82f6-4e3a-923f-8978d50970aa None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:19.383925 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f186-82f6-4e3a-923f-8978d50970aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:19.385221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9f186-82f6-4e3a-923f-8978d50970aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:19.386868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9f186-82f6-4e3a-923f-8978d50970aa None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:19.393254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 114/239] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:19.394619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f186-82f6-4e3a-923f-8978d50970aa None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:19.427836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40d481-7a42-4f6b-8051-f1555dd44cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:19.428652 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40d481-7a42-4f6b-8051-f1555dd44cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:19.428931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40d481-7a42-4f6b-8051-f1555dd44cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:19.429202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40d481-7a42-4f6b-8051-f1555dd44cf6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:19.459790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40d481-7a42-4f6b-8051-f1555dd44cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-2d40d481-7a42-4f6b-8051-f1555dd44cf6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:19.475531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:19.476667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:19.477690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 126/240] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:19.488834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40d481-7a42-4f6b-8051-f1555dd44cf6 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:19.505620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f186-82f6-4e3a-923f-8978d50970aa None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:19.539792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfc1c5-f4f0-4f16-a81f-c765aadf6610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:19.540700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfc1c5-f4f0-4f16-a81f-c765aadf6610 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:19.541155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfc1c5-f4f0-4f16-a81f-c765aadf6610 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:19.541575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfc1c5-f4f0-4f16-a81f-c765aadf6610 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:19.542437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfc1c5-f4f0-4f16-a81f-c765aadf6610 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:19.544067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfc1c5-f4f0-4f16-a81f-c765aadf6610 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:19.630281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40d481-7a42-4f6b-8051-f1555dd44cf6 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:19.663168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 115/241] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:07:19 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:07:19.674961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666377d-7eb5-435b-8c59-36495d8958a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:19.675815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666377d-7eb5-435b-8c59-36495d8958a9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:19.676096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666377d-7eb5-435b-8c59-36495d8958a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:19.676416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666377d-7eb5-435b-8c59-36495d8958a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:19.677213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666377d-7eb5-435b-8c59-36495d8958a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:19.677560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666377d-7eb5-435b-8c59-36495d8958a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:19.682134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666377d-7eb5-435b-8c59-36495d8958a9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:19.692186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 127/242] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:19.697469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfc1c5-f4f0-4f16-a81f-c765aadf6610 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:19.852437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfc1c5-f4f0-4f16-a81f-c765aadf6610 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:19.889516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74485-b20f-4168-b31f-837aaf76f590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:19.890415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74485-b20f-4168-b31f-837aaf76f590 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:19.890694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74485-b20f-4168-b31f-837aaf76f590 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:19.890966 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74485-b20f-4168-b31f-837aaf76f590 None admin] PATH_INFO: `/v3/users/2bd21cae0ad144be846afb5dca3d2b4f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:19.906329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e74485-b20f-4168-b31f-837aaf76f590 None admin] RBAC: Authorizing `identity:get_user(user_id=2bd21cae0ad144be846afb5dca3d2b4f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:19.907898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e74485-b20f-4168-b31f-837aaf76f590 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:19.909730 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 116/243] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:19 2022] GET /identity/v3/users/2bd21cae0ad144be846afb5dca3d2b4f => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:19.915522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666377d-7eb5-435b-8c59-36495d8958a9 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:20.036015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666377d-7eb5-435b-8c59-36495d8958a9 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:20.064438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593af89-494e-492d-b73c-4386e2d645d9 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.064943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593af89-494e-492d-b73c-4386e2d645d9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.065579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593af89-494e-492d-b73c-4386e2d645d9 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.066897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 117/244] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:20.072560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8e02d-526f-4c60-9048-cb23ac24e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:20.072802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c2647-418e-47d7-ae54-f6f1f5906252 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.073042 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c2647-418e-47d7-ae54-f6f1f5906252 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.073633 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c2647-418e-47d7-ae54-f6f1f5906252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.074329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8e02d-526f-4c60-9048-cb23ac24e1ca None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.074823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8e02d-526f-4c60-9048-cb23ac24e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.075394 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8e02d-526f-4c60-9048-cb23ac24e1ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.093174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a32c2647-418e-47d7-ae54-f6f1f5906252 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:20.094571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a32c2647-418e-47d7-ae54-f6f1f5906252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:20.145983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8e02d-526f-4c60-9048-cb23ac24e1ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:20.147778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8e02d-526f-4c60-9048-cb23ac24e1ca None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:20.166574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 118/245] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:20.168092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5fbdd-afb4-4f63-914a-e732dc6796a6 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.168445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5fbdd-afb4-4f63-914a-e732dc6796a6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.168821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5fbdd-afb4-4f63-914a-e732dc6796a6 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.170433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 119/246] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:20.175989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc10a9-bacc-4492-8b70-29445b0850f6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.176383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc10a9-bacc-4492-8b70-29445b0850f6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.176769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc10a9-bacc-4492-8b70-29445b0850f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.193931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e3bc10a9-bacc-4492-8b70-29445b0850f6 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:20.195495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e3bc10a9-bacc-4492-8b70-29445b0850f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:20.273421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 128/247] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:20.274276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8e02d-526f-4c60-9048-cb23ac24e1ca None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:20.298525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 120/248] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:20.300167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc10a9-bacc-4492-8b70-29445b0850f6 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:20.401723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8e02d-526f-4c60-9048-cb23ac24e1ca None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:20.426529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc10a9-bacc-4492-8b70-29445b0850f6 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:20.447209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bfc53-0817-4092-8d51-93c59a38109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:20.448615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bfc53-0817-4092-8d51-93c59a38109d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.449104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bfc53-0817-4092-8d51-93c59a38109d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.449578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bfc53-0817-4092-8d51-93c59a38109d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.464077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bfc53-0817-4092-8d51-93c59a38109d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:20.468352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab2cf1-184b-42d0-aaa0-afc0e88e5c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:20.469428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab2cf1-184b-42d0-aaa0-afc0e88e5c03 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.469850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab2cf1-184b-42d0-aaa0-afc0e88e5c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.470286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab2cf1-184b-42d0-aaa0-afc0e88e5c03 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.472248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab2cf1-184b-42d0-aaa0-afc0e88e5c03 None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-aa4bfc53-0817-4092-8d51-93c59a38109d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:20.473187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:20.474130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:20.474913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:20.475580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 129/249] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:20.476781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab2cf1-184b-42d0-aaa0-afc0e88e5c03 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:20.478980 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 121/250] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:20 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:20.479598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bfc53-0817-4092-8d51-93c59a38109d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:20.485589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41d80-5b15-432b-8ff6-9f8291943aa9 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.486375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41d80-5b15-432b-8ff6-9f8291943aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.488370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41d80-5b15-432b-8ff6-9f8291943aa9 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.490055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 122/251] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:20.490963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de41d80-5b15-432b-8ff6-9f8291943aa9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:20.597349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bfc53-0817-4092-8d51-93c59a38109d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:20.606471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de41d80-5b15-432b-8ff6-9f8291943aa9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:20.630863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd2220-7985-42b9-b347-c713f02b6e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:20.632010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd2220-7985-42b9-b347-c713f02b6e71 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.632514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd2220-7985-42b9-b347-c713f02b6e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.632984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd2220-7985-42b9-b347-c713f02b6e71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.644405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd2220-7985-42b9-b347-c713f02b6e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:20.647632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cafbab-09a8-495e-9071-2cbdf2b75466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:20.648306 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cafbab-09a8-495e-9071-2cbdf2b75466 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.648582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cafbab-09a8-495e-9071-2cbdf2b75466 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.648863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cafbab-09a8-495e-9071-2cbdf2b75466 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.649636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cafbab-09a8-495e-9071-2cbdf2b75466 None admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:20.649929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cafbab-09a8-495e-9071-2cbdf2b75466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:20.651365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cafbab-09a8-495e-9071-2cbdf2b75466 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-75cd2220-7985-42b9-b347-c713f02b6e71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:20.655572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:20.656443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:20.657211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:20.664931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 130/253] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:20.665368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 123/253] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:20.666222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cafbab-09a8-495e-9071-2cbdf2b75466 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:20.667330 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3ff0-1958-494b-b455-9c9e9b283199 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.667847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3ff0-1958-494b-b455-9c9e9b283199 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.668329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3ff0-1958-494b-b455-9c9e9b283199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.685619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-966a3ff0-1958-494b-b455-9c9e9b283199 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:20.688295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-966a3ff0-1958-494b-b455-9c9e9b283199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:20.773161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 131/254] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:20.774323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a3ff0-1958-494b-b455-9c9e9b283199 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:20.798884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cafbab-09a8-495e-9071-2cbdf2b75466 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:20.834931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5fd94-bc3f-44c1-9c4a-5f00bcaf17d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:20.835968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5fd94-bc3f-44c1-9c4a-5f00bcaf17d6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.836443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5fd94-bc3f-44c1-9c4a-5f00bcaf17d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.836907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5fd94-bc3f-44c1-9c4a-5f00bcaf17d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.837948 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5fd94-bc3f-44c1-9c4a-5f00bcaf17d6 None admin] RBAC: Adding query filter params (role.id=857d25aa9bd04e0b90ba9a17aba49c51, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4, user.id=2bd21cae0ad144be846afb5dca3d2b4f) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:20.838505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5fd94-bc3f-44c1-9c4a-5f00bcaf17d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:20.840685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5fd94-bc3f-44c1-9c4a-5f00bcaf17d6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:20.847615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 124/255] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:20 2022] GET /identity/v3/role_assignments?user.id=2bd21cae0ad144be846afb5dca3d2b4f&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=857d25aa9bd04e0b90ba9a17aba49c51 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:20.848663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5fd94-bc3f-44c1-9c4a-5f00bcaf17d6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:20.908535 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a3ff0-1958-494b-b455-9c9e9b283199 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:20.956765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab5fd1-58f8-4b0c-8c15-7952f4c8e5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:20.957484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab5fd1-58f8-4b0c-8c15-7952f4c8e5da None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:20.957770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab5fd1-58f8-4b0c-8c15-7952f4c8e5da None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:20.958109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab5fd1-58f8-4b0c-8c15-7952f4c8e5da None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:20.959309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab5fd1-58f8-4b0c-8c15-7952f4c8e5da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:20.959775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab5fd1-58f8-4b0c-8c15-7952f4c8e5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:20.962056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab5fd1-58f8-4b0c-8c15-7952f4c8e5da None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:20.962607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5fd94-bc3f-44c1-9c4a-5f00bcaf17d6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:20.973248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 132/256] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:20.973834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab5fd1-58f8-4b0c-8c15-7952f4c8e5da None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:21.006000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dbbc0-ede0-467b-8c9e-ffe7b3011c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:21.007322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dbbc0-ede0-467b-8c9e-ffe7b3011c10 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:21.007777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dbbc0-ede0-467b-8c9e-ffe7b3011c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:21.008397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dbbc0-ede0-467b-8c9e-ffe7b3011c10 None admin] PATH_INFO: `/v3/users/9913c50c5ca54208b737b15dfddde887` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:21.011648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dbbc0-ede0-467b-8c9e-ffe7b3011c10 None admin] RBAC: Authorizing `identity:get_user(user_id=9913c50c5ca54208b737b15dfddde887)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:21.011648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dbbc0-ede0-467b-8c9e-ffe7b3011c10 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:21.013245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 125/257] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:20 2022] GET /identity/v3/users/9913c50c5ca54208b737b15dfddde887 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:21.014182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dbbc0-ede0-467b-8c9e-ffe7b3011c10 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:21.123278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab5fd1-58f8-4b0c-8c15-7952f4c8e5da None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:21.168666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a2d51-c085-4360-a8f1-3f235ff16e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:21.169425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2d51-c085-4360-a8f1-3f235ff16e91 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:21.169714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2d51-c085-4360-a8f1-3f235ff16e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:21.169996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2d51-c085-4360-a8f1-3f235ff16e91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:21.180894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dbbc0-ede0-467b-8c9e-ffe7b3011c10 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:21.192801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a2d51-c085-4360-a8f1-3f235ff16e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-b65a2d51-c085-4360-a8f1-3f235ff16e91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:21.206445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:21.207398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:21.208183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:21.214180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 133/258] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:21.215059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a2d51-c085-4360-a8f1-3f235ff16e91 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:21.221807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef62e8-d31d-482b-b662-9681c60a02d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:21.222865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef62e8-d31d-482b-b662-9681c60a02d7 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:21.223315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef62e8-d31d-482b-b662-9681c60a02d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:21.223751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef62e8-d31d-482b-b662-9681c60a02d7 None admin] PATH_INFO: `/v3/users/82614fb4ae254b1da884c46d41c06628` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:21.225088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef62e8-d31d-482b-b662-9681c60a02d7 None admin] RBAC: Authorizing `identity:get_user(user_id=82614fb4ae254b1da884c46d41c06628)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:21.226707 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef62e8-d31d-482b-b662-9681c60a02d7 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:21.228514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 126/259] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:21 2022] GET /identity/v3/users/82614fb4ae254b1da884c46d41c06628 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:21.229410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef62e8-d31d-482b-b662-9681c60a02d7 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:21.335006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef62e8-d31d-482b-b662-9681c60a02d7 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:21.342250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a2d51-c085-4360-a8f1-3f235ff16e91 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:21.369363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266903-69cb-43f6-ad76-0ef68388313a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:21.370348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266903-69cb-43f6-ad76-0ef68388313a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:21.370769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266903-69cb-43f6-ad76-0ef68388313a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:21.371204 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266903-69cb-43f6-ad76-0ef68388313a None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:21.372103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90266903-69cb-43f6-ad76-0ef68388313a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:21.372568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90266903-69cb-43f6-ad76-0ef68388313a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:21.374134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90266903-69cb-43f6-ad76-0ef68388313a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:21.383600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 127/260] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:21.384650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266903-69cb-43f6-ad76-0ef68388313a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:21.408387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b607a9-5f6d-4636-bd0a-241cc10bfd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:21.409360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b607a9-5f6d-4636-bd0a-241cc10bfd8d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:21.409680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b607a9-5f6d-4636-bd0a-241cc10bfd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:21.409921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b607a9-5f6d-4636-bd0a-241cc10bfd8d None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:21.415970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b607a9-5f6d-4636-bd0a-241cc10bfd8d None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:21.417640 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b607a9-5f6d-4636-bd0a-241cc10bfd8d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:21.419555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 134/261] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:21 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:21.420280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b607a9-5f6d-4636-bd0a-241cc10bfd8d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:21.488213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266903-69cb-43f6-ad76-0ef68388313a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:21.522156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46317f2-8e6b-446b-bd17-88b2ce0f58f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:21.523085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46317f2-8e6b-446b-bd17-88b2ce0f58f3 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:21.523537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46317f2-8e6b-446b-bd17-88b2ce0f58f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:21.523952 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46317f2-8e6b-446b-bd17-88b2ce0f58f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:21.594339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46317f2-8e6b-446b-bd17-88b2ce0f58f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:21.596086 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46317f2-8e6b-446b-bd17-88b2ce0f58f3 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:21.686861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b607a9-5f6d-4636-bd0a-241cc10bfd8d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:21.694785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 128/262] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:21.700092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46317f2-8e6b-446b-bd17-88b2ce0f58f3 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:21.775836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d279b5-4a9a-498a-b740-a1e363fa70e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:21.776899 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d279b5-4a9a-498a-b740-a1e363fa70e6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:21.777291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d279b5-4a9a-498a-b740-a1e363fa70e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:21.777677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d279b5-4a9a-498a-b740-a1e363fa70e6 None admin] PATH_INFO: `/v3/users/82614fb4ae254b1da884c46d41c06628` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:21.779307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d279b5-4a9a-498a-b740-a1e363fa70e6 None admin] RBAC: Authorizing `identity:get_user(user_id=82614fb4ae254b1da884c46d41c06628)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:21.780858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d279b5-4a9a-498a-b740-a1e363fa70e6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:21.782612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 135/263] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:21 2022] GET /identity/v3/users/82614fb4ae254b1da884c46d41c06628 => generated 283 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:21.783516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d279b5-4a9a-498a-b740-a1e363fa70e6 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:21.801136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46317f2-8e6b-446b-bd17-88b2ce0f58f3 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:21.835617 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c0142-b103-4cba-a750-b577f61032d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:21.836701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0142-b103-4cba-a750-b577f61032d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:21.837108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0142-b103-4cba-a750-b577f61032d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:21.837530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0142-b103-4cba-a750-b577f61032d8 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/users/9913c50c5ca54208b737b15dfddde887/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:21.839613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0142-b103-4cba-a750-b577f61032d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4, user_id=9913c50c5ca54208b737b15dfddde887, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:21.841208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0142-b103-4cba-a750-b577f61032d8 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:21.923883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 129/264] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:07:21 2022] PUT /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/users/9913c50c5ca54208b737b15dfddde887/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:21.925027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c0142-b103-4cba-a750-b577f61032d8 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:21.933487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d279b5-4a9a-498a-b740-a1e363fa70e6 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:21.999158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a8240-9224-422d-a13c-e654f1d61d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:21.999158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a8240-9224-422d-a13c-e654f1d61d3a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:21.999158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a8240-9224-422d-a13c-e654f1d61d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:21.999158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a8240-9224-422d-a13c-e654f1d61d3a None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:21.999564 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a8240-9224-422d-a13c-e654f1d61d3a None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:21.999564 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a8240-9224-422d-a13c-e654f1d61d3a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:21.999564 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 136/265] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:21 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:22.008481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a8240-9224-422d-a13c-e654f1d61d3a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:22.207942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c0142-b103-4cba-a750-b577f61032d8 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:22.208456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a8240-9224-422d-a13c-e654f1d61d3a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:22.258887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c8e78-a808-48ed-9f3c-59f0c9526999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:22.259492 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c8e78-a808-48ed-9f3c-59f0c9526999 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:22.259783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c8e78-a808-48ed-9f3c-59f0c9526999 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:22.260057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c8e78-a808-48ed-9f3c-59f0c9526999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:22.266531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f07a8-f099-4ff8-b6eb-0eca4ec2cec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:22.267219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f07a8-f099-4ff8-b6eb-0eca4ec2cec5 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:22.267503 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f07a8-f099-4ff8-b6eb-0eca4ec2cec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:22.267779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f07a8-f099-4ff8-b6eb-0eca4ec2cec5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:22.268660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f07a8-f099-4ff8-b6eb-0eca4ec2cec5 None admin] RBAC: Adding query filter params (role.id=1efabb1110d64eebacd85d9016d7d286, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4, user.id=82614fb4ae254b1da884c46d41c06628) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:22.268973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f07a8-f099-4ff8-b6eb-0eca4ec2cec5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:22.270460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f07a8-f099-4ff8-b6eb-0eca4ec2cec5 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:22.282940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 137/266] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:22 2022] GET /identity/v3/role_assignments?user.id=82614fb4ae254b1da884c46d41c06628&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=1efabb1110d64eebacd85d9016d7d286 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:22.342047 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c8e78-a808-48ed-9f3c-59f0c9526999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:22.343593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c8e78-a808-48ed-9f3c-59f0c9526999 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:22.465265 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 130/267] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:22.470994 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f07a8-f099-4ff8-b6eb-0eca4ec2cec5 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:22.584315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f07a8-f099-4ff8-b6eb-0eca4ec2cec5 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:22.628937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeb870-43c9-4574-972c-965f7c956acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:22.629834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb870-43c9-4574-972c-965f7c956acb None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:22.630118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb870-43c9-4574-972c-965f7c956acb None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:22.630395 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb870-43c9-4574-972c-965f7c956acb None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:22.631808 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeb870-43c9-4574-972c-965f7c956acb None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:22.633356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeb870-43c9-4574-972c-965f7c956acb None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:22.635271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 138/268] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:22 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:22.641716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c8e78-a808-48ed-9f3c-59f0c9526999 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:22.756567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c8e78-a808-48ed-9f3c-59f0c9526999 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:22.796670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3ad65-2236-4c06-8b26-39224d5dc1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:22.797329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ad65-2236-4c06-8b26-39224d5dc1db None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:22.797610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ad65-2236-4c06-8b26-39224d5dc1db None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:22.797881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ad65-2236-4c06-8b26-39224d5dc1db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:22.798711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3ad65-2236-4c06-8b26-39224d5dc1db None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4, user.id=82614fb4ae254b1da884c46d41c06628) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:22.799019 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3ad65-2236-4c06-8b26-39224d5dc1db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:22.800631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3ad65-2236-4c06-8b26-39224d5dc1db None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:22.808679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 131/269] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:22 2022] GET /identity/v3/role_assignments?user.id=82614fb4ae254b1da884c46d41c06628&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=2791519d9bad43318f086666b6e64a20 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:22.821928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613abd-a488-407b-83f5-5c80c23af924 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:22.822238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613abd-a488-407b-83f5-5c80c23af924 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:22.822490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613abd-a488-407b-83f5-5c80c23af924 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:22.824154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 139/270] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:22.829896 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaea00-7ecf-4282-a0aa-8e12224e8307 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:22.830188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaea00-7ecf-4282-a0aa-8e12224e8307 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:22.831081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaea00-7ecf-4282-a0aa-8e12224e8307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:22.855392 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2daaea00-7ecf-4282-a0aa-8e12224e8307 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:22.855392 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2daaea00-7ecf-4282-a0aa-8e12224e8307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:22.951553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 132/271] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:22.994579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2613abd-a488-407b-83f5-5c80c23af924 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:23.136437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2613abd-a488-407b-83f5-5c80c23af924 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:23.174193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3273e89-232d-42df-a63f-581bf173624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:23.175646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273e89-232d-42df-a63f-581bf173624c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:23.175931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273e89-232d-42df-a63f-581bf173624c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:23.176204 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273e89-232d-42df-a63f-581bf173624c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:23.186962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445bf1c-cb3a-4725-9287-3177afa8a737 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:23.187529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445bf1c-cb3a-4725-9287-3177afa8a737 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:23.187977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445bf1c-cb3a-4725-9287-3177afa8a737 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:23.189515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 133/272] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:23.193386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3273e89-232d-42df-a63f-581bf173624c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:23.194909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c832e-0e61-4ab6-8930-e13a0f505169 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:23.195225 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c832e-0e61-4ab6-8930-e13a0f505169 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:23.195509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c832e-0e61-4ab6-8930-e13a0f505169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-f3273e89-232d-42df-a63f-581bf173624c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:23.199892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:23.200776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:23.201571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 140/273] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:23.206882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3273e89-232d-42df-a63f-581bf173624c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:23.225567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0e0c832e-0e61-4ab6-8930-e13a0f505169 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:23.230315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0e0c832e-0e61-4ab6-8930-e13a0f505169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:23.317030 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 134/274] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:23.329294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3273e89-232d-42df-a63f-581bf173624c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:23.344961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c832e-0e61-4ab6-8930-e13a0f505169 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:23.370684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660c35-7fde-4997-aad5-6fdaa0bfbb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:23.371407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660c35-7fde-4997-aad5-6fdaa0bfbb34 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:23.371691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660c35-7fde-4997-aad5-6fdaa0bfbb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:23.371966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660c35-7fde-4997-aad5-6fdaa0bfbb34 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:23.372724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8660c35-7fde-4997-aad5-6fdaa0bfbb34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:23.373029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8660c35-7fde-4997-aad5-6fdaa0bfbb34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:23.374512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8660c35-7fde-4997-aad5-6fdaa0bfbb34 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:23.388499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 141/275] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:23.393802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660c35-7fde-4997-aad5-6fdaa0bfbb34 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:23.472957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c832e-0e61-4ab6-8930-e13a0f505169 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:23.499425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660c35-7fde-4997-aad5-6fdaa0bfbb34 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:23.515276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b32e9f-8931-46be-872f-3d9bb79021cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:23.516650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b32e9f-8931-46be-872f-3d9bb79021cd None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:23.517144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b32e9f-8931-46be-872f-3d9bb79021cd None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:23.517614 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b32e9f-8931-46be-872f-3d9bb79021cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:23.519935 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b32e9f-8931-46be-872f-3d9bb79021cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:23.521930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b32e9f-8931-46be-872f-3d9bb79021cd None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:23.524784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 135/276] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:23.530226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b32e9f-8931-46be-872f-3d9bb79021cd None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:23.538094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca6d7-94a4-4e07-b761-69a4c2d4c7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:23.538999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca6d7-94a4-4e07-b761-69a4c2d4c7fe None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:23.539340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca6d7-94a4-4e07-b761-69a4c2d4c7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:23.539617 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca6d7-94a4-4e07-b761-69a4c2d4c7fe None admin] PATH_INFO: `/v3/users/4d4ac29582de4d6496e87d8e1c745f99` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:23.553253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecca6d7-94a4-4e07-b761-69a4c2d4c7fe None admin] RBAC: Authorizing `identity:get_user(user_id=4d4ac29582de4d6496e87d8e1c745f99)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:23.554731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecca6d7-94a4-4e07-b761-69a4c2d4c7fe None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:23.556771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 142/277] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:23 2022] GET /identity/v3/users/4d4ac29582de4d6496e87d8e1c745f99 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:23.562242 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca6d7-94a4-4e07-b761-69a4c2d4c7fe None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:23.634884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b32e9f-8931-46be-872f-3d9bb79021cd None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:23.668416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca6d7-94a4-4e07-b761-69a4c2d4c7fe None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:23.672814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31da10-e676-4288-9abf-b6a55f194cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:23.673847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31da10-e676-4288-9abf-b6a55f194cf6 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:23.674349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31da10-e676-4288-9abf-b6a55f194cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:23.674817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31da10-e676-4288-9abf-b6a55f194cf6 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:23.675791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31da10-e676-4288-9abf-b6a55f194cf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:23.677752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31da10-e676-4288-9abf-b6a55f194cf6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:23.703250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc311e67-dbc3-4530-887e-562f2e212f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:23.703908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc311e67-dbc3-4530-887e-562f2e212f2a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:23.704192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc311e67-dbc3-4530-887e-562f2e212f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:23.707908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc311e67-dbc3-4530-887e-562f2e212f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:23.707908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc311e67-dbc3-4530-887e-562f2e212f2a None admin] RBAC: Adding query filter params (role.id=52bafac2651a4075879b7d97a4f9111e, user.id=4d4ac29582de4d6496e87d8e1c745f99, scope.system=all) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:23.707908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc311e67-dbc3-4530-887e-562f2e212f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:23.707908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc311e67-dbc3-4530-887e-562f2e212f2a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:23.713024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 143/278] 10.222.0.64 () {56 vars in 1308 bytes} [Fri May 13 17:07:23 2022] GET /identity/v3/role_assignments?user.id=4d4ac29582de4d6496e87d8e1c745f99&scope.system=all&role.id=52bafac2651a4075879b7d97a4f9111e => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:23.774176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 136/279] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:07:23 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:07:23.806029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6b75f-d5c7-4a3e-b870-6778db8549d2 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:23.806362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6b75f-d5c7-4a3e-b870-6778db8549d2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:23.806598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6b75f-d5c7-4a3e-b870-6778db8549d2 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:23.808411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 144/280] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:23.817317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a7d12-3278-4508-9aac-653563299c8c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:23.820552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a7d12-3278-4508-9aac-653563299c8c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:23.820552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a7d12-3278-4508-9aac-653563299c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:23.836733 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b29a7d12-3278-4508-9aac-653563299c8c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:23.838071 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b29a7d12-3278-4508-9aac-653563299c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:23.913853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 137/281] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:23.937614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6b75f-d5c7-4a3e-b870-6778db8549d2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:24.045130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6b75f-d5c7-4a3e-b870-6778db8549d2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:24.080315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55f848-f32e-4c72-a691-19b5d1003616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:24.081499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55f848-f32e-4c72-a691-19b5d1003616 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:24.081959 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55f848-f32e-4c72-a691-19b5d1003616 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:24.082407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55f848-f32e-4c72-a691-19b5d1003616 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:24.093409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55f848-f32e-4c72-a691-19b5d1003616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-1c55f848-f32e-4c72-a691-19b5d1003616 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:24.102133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:24.103033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:24.103840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:24.106233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 145/282] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:24.112558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a7d12-3278-4508-9aac-653563299c8c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:24.217394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a7d12-3278-4508-9aac-653563299c8c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:24.253228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0ff88-3442-4e77-ac6e-a028c9616fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:24.253998 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ff88-3442-4e77-ac6e-a028c9616fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:24.254181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ff88-3442-4e77-ac6e-a028c9616fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:24.254456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ff88-3442-4e77-ac6e-a028c9616fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:24.255244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0ff88-3442-4e77-ac6e-a028c9616fa5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:24.255550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0ff88-3442-4e77-ac6e-a028c9616fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:24.256992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0ff88-3442-4e77-ac6e-a028c9616fa5 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:24.265887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 138/283] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:24.272002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55f848-f32e-4c72-a691-19b5d1003616 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:24.395850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55f848-f32e-4c72-a691-19b5d1003616 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:24.443853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6d6c6-35a0-4652-9c68-3c889c7e812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:24.444745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6d6c6-35a0-4652-9c68-3c889c7e812d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:24.445032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6d6c6-35a0-4652-9c68-3c889c7e812d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:24.445310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6d6c6-35a0-4652-9c68-3c889c7e812d None admin] PATH_INFO: `/v3/users/2bd21cae0ad144be846afb5dca3d2b4f` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:24.446574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6d6c6-35a0-4652-9c68-3c889c7e812d None admin] RBAC: Authorizing `identity:get_user(user_id=2bd21cae0ad144be846afb5dca3d2b4f)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:24.448092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6d6c6-35a0-4652-9c68-3c889c7e812d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:24.449999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 146/284] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:24 2022] GET /identity/v3/users/2bd21cae0ad144be846afb5dca3d2b4f => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:24.455540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0ff88-3442-4e77-ac6e-a028c9616fa5 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:24.585213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0ff88-3442-4e77-ac6e-a028c9616fa5 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:24.619102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240f11a-6ae5-4a95-a4a7-f66c7d98384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:24.619994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f11a-6ae5-4a95-a4a7-f66c7d98384b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:24.620266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f11a-6ae5-4a95-a4a7-f66c7d98384b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:24.620543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f11a-6ae5-4a95-a4a7-f66c7d98384b None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:24.621732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240f11a-6ae5-4a95-a4a7-f66c7d98384b None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:24.623326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240f11a-6ae5-4a95-a4a7-f66c7d98384b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:24.625164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 139/285] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:24 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:24.631374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6d6c6-35a0-4652-9c68-3c889c7e812d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:24.758740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6d6c6-35a0-4652-9c68-3c889c7e812d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:24.797205 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d30b18-8115-4a37-a3dd-afb6cd95cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:24.798396 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30b18-8115-4a37-a3dd-afb6cd95cf68 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:24.798857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30b18-8115-4a37-a3dd-afb6cd95cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:24.799931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30b18-8115-4a37-a3dd-afb6cd95cf68 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/users/2bd21cae0ad144be846afb5dca3d2b4f/roles/857d25aa9bd04e0b90ba9a17aba49c51` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:24.802097 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d30b18-8115-4a37-a3dd-afb6cd95cf68 None admin] RBAC: Authorizing `identity:create_grant(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4, user_id=2bd21cae0ad144be846afb5dca3d2b4f, role_id=857d25aa9bd04e0b90ba9a17aba49c51)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:24.803776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d30b18-8115-4a37-a3dd-afb6cd95cf68 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:24.877154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b72c-ffd3-4744-bd82-7a45a9e1a5c1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:24.877467 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b72c-ffd3-4744-bd82-7a45a9e1a5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:24.877739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b72c-ffd3-4744-bd82-7a45a9e1a5c1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:24.879112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 140/286] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:24.884200 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2f815-4d9d-42f1-8d5b-4319e43b8a2d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:24.884486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2f815-4d9d-42f1-8d5b-4319e43b8a2d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:24.884757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2f815-4d9d-42f1-8d5b-4319e43b8a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:24.888669 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 147/287] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:07:24 2022] PUT /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/users/2bd21cae0ad144be846afb5dca3d2b4f/roles/857d25aa9bd04e0b90ba9a17aba49c51 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:24.910360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-55d2f815-4d9d-42f1-8d5b-4319e43b8a2d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:24.911613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-55d2f815-4d9d-42f1-8d5b-4319e43b8a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:25.020459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 141/288] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:25.055940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d30b18-8115-4a37-a3dd-afb6cd95cf68 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:25.187859 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d30b18-8115-4a37-a3dd-afb6cd95cf68 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:25.223694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d91b0-4eb8-4cfd-9024-492c9d507df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:25.224626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d91b0-4eb8-4cfd-9024-492c9d507df2 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:25.224924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d91b0-4eb8-4cfd-9024-492c9d507df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:25.225201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d91b0-4eb8-4cfd-9024-492c9d507df2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:25.235781 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d91b0-4eb8-4cfd-9024-492c9d507df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-347d91b0-4eb8-4cfd-9024-492c9d507df2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:25.243756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:25.244636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:25.245437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 148/289] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:25.250578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2f815-4d9d-42f1-8d5b-4319e43b8a2d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:25.349908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2f815-4d9d-42f1-8d5b-4319e43b8a2d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:25.392428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531dbb2-4f3d-44ec-98ae-3affb7aacfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:25.393134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531dbb2-4f3d-44ec-98ae-3affb7aacfcb None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:25.393415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531dbb2-4f3d-44ec-98ae-3affb7aacfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:25.393739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531dbb2-4f3d-44ec-98ae-3affb7aacfcb None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:25.394497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531dbb2-4f3d-44ec-98ae-3affb7aacfcb None admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:25.394799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531dbb2-4f3d-44ec-98ae-3affb7aacfcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:25.396229 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531dbb2-4f3d-44ec-98ae-3affb7aacfcb None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:25.405017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 142/290] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:25.415961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d91b0-4eb8-4cfd-9024-492c9d507df2 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:25.524372 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d91b0-4eb8-4cfd-9024-492c9d507df2 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:25.565219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0a6b-7d70-4cf8-98f1-63cd5de126b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:25.566113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0a6b-7d70-4cf8-98f1-63cd5de126b3 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:25.566396 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0a6b-7d70-4cf8-98f1-63cd5de126b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:25.566673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0a6b-7d70-4cf8-98f1-63cd5de126b3 None admin] PATH_INFO: `/v3/users/9913c50c5ca54208b737b15dfddde887` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:25.568726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d0a6b-7d70-4cf8-98f1-63cd5de126b3 None admin] RBAC: Authorizing `identity:get_user(user_id=9913c50c5ca54208b737b15dfddde887)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:25.570240 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d0a6b-7d70-4cf8-98f1-63cd5de126b3 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:25.572079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 149/291] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:25 2022] GET /identity/v3/users/9913c50c5ca54208b737b15dfddde887 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:25.577588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531dbb2-4f3d-44ec-98ae-3affb7aacfcb None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:25.681107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531dbb2-4f3d-44ec-98ae-3affb7aacfcb None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:25.724995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd61b9-ba3b-47ed-a33b-18c8b42c423c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:25.725769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd61b9-ba3b-47ed-a33b-18c8b42c423c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:25.725968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd61b9-ba3b-47ed-a33b-18c8b42c423c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:25.726199 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd61b9-ba3b-47ed-a33b-18c8b42c423c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:25.796343 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd61b9-ba3b-47ed-a33b-18c8b42c423c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:25.797809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd61b9-ba3b-47ed-a33b-18c8b42c423c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:25.897486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 143/292] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:25.903318 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0a6b-7d70-4cf8-98f1-63cd5de126b3 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:26.031061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0a6b-7d70-4cf8-98f1-63cd5de126b3 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:26.083543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0475ed0-cc1a-4eaf-b7b5-7c009135609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:26.084700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0475ed0-cc1a-4eaf-b7b5-7c009135609b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:26.085169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0475ed0-cc1a-4eaf-b7b5-7c009135609b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:26.085643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0475ed0-cc1a-4eaf-b7b5-7c009135609b None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:26.091852 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0475ed0-cc1a-4eaf-b7b5-7c009135609b None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:26.093517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0475ed0-cc1a-4eaf-b7b5-7c009135609b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:26.095466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 150/293] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:25 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:26.101259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd61b9-ba3b-47ed-a33b-18c8b42c423c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:26.243386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef8c9a-be6f-4a0a-8552-b812fff1539a None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:26.244051 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef8c9a-be6f-4a0a-8552-b812fff1539a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:26.244555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef8c9a-be6f-4a0a-8552-b812fff1539a None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:26.246394 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 151/294] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:26.251717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08cfa5-a06f-4ba2-abcc-076d19ae4b8b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:26.252244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08cfa5-a06f-4ba2-abcc-076d19ae4b8b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:26.252784 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08cfa5-a06f-4ba2-abcc-076d19ae4b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:26.256832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd61b9-ba3b-47ed-a33b-18c8b42c423c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:26.283521 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-8e08cfa5-a06f-4ba2-abcc-076d19ae4b8b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:26.285621 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8e08cfa5-a06f-4ba2-abcc-076d19ae4b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:26.315913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c8c62-35a4-4249-b492-2c13b844597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:26.316967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c8c62-35a4-4249-b492-2c13b844597f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:26.317453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c8c62-35a4-4249-b492-2c13b844597f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:26.317932 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c8c62-35a4-4249-b492-2c13b844597f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:26.319735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c8c62-35a4-4249-b492-2c13b844597f None admin] RBAC: Adding query filter params (role.id=52bafac2651a4075879b7d97a4f9111e, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4, user.id=9913c50c5ca54208b737b15dfddde887) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:26.320439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c8c62-35a4-4249-b492-2c13b844597f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:26.323229 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c8c62-35a4-4249-b492-2c13b844597f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:26.334272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 144/295] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:26 2022] GET /identity/v3/role_assignments?user.id=9913c50c5ca54208b737b15dfddde887&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=52bafac2651a4075879b7d97a4f9111e => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:26.381785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 152/296] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:26.404974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c8c62-35a4-4249-b492-2c13b844597f None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:26.512995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c8c62-35a4-4249-b492-2c13b844597f None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:26.549086 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7994e-f112-492e-b5dc-9d2056db5057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:26.550791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7994e-f112-492e-b5dc-9d2056db5057 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:26.551312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7994e-f112-492e-b5dc-9d2056db5057 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:26.551788 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7994e-f112-492e-b5dc-9d2056db5057 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:26.564197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7994e-f112-492e-b5dc-9d2056db5057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-dde7994e-f112-492e-b5dc-9d2056db5057 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:26.573757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:26.574701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:26.575561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:26.578419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 145/297] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:26.585527 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08cfa5-a06f-4ba2-abcc-076d19ae4b8b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:26.724808 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08cfa5-a06f-4ba2-abcc-076d19ae4b8b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:26.770226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06c3dd-65ac-4654-8e3e-c349a0f9f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:26.770907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06c3dd-65ac-4654-8e3e-c349a0f9f844 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:26.771215 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06c3dd-65ac-4654-8e3e-c349a0f9f844 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:26.771490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06c3dd-65ac-4654-8e3e-c349a0f9f844 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:26.772247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06c3dd-65ac-4654-8e3e-c349a0f9f844 None admin] RBAC: Adding query filter params (name=member) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:26.772550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06c3dd-65ac-4654-8e3e-c349a0f9f844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:26.773957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06c3dd-65ac-4654-8e3e-c349a0f9f844 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:26.785346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 153/298] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:26.791206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7994e-f112-492e-b5dc-9d2056db5057 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:26.901176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7994e-f112-492e-b5dc-9d2056db5057 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:26.919607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac965a-6773-4f1b-96ad-54ae6306b26b None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:26.919898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac965a-6773-4f1b-96ad-54ae6306b26b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:26.920165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac965a-6773-4f1b-96ad-54ae6306b26b None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:26.921876 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 154/299] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:26.929239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8706188-37b1-4510-87e4-749b261177e2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:26.929903 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8706188-37b1-4510-87e4-749b261177e2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:26.930384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8706188-37b1-4510-87e4-749b261177e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:26.945038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08797b-f79d-438f-ba52-5181efb76ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:26.947463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08797b-f79d-438f-ba52-5181efb76ecc None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:26.947463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08797b-f79d-438f-ba52-5181efb76ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:26.947463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08797b-f79d-438f-ba52-5181efb76ecc None admin] PATH_INFO: `/v3/users/4d4ac29582de4d6496e87d8e1c745f99` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:26.949283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08797b-f79d-438f-ba52-5181efb76ecc None admin] RBAC: Authorizing `identity:get_user(user_id=4d4ac29582de4d6496e87d8e1c745f99)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:26.950761 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08797b-f79d-438f-ba52-5181efb76ecc None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:26.952762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 146/300] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:26 2022] GET /identity/v3/users/4d4ac29582de4d6496e87d8e1c745f99 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:26.957756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e8706188-37b1-4510-87e4-749b261177e2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:26.959282 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e8706188-37b1-4510-87e4-749b261177e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:26.961687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08797b-f79d-438f-ba52-5181efb76ecc None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:27.039149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 155/301] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:27.039149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf38d1-0010-47b5-a3fc-58cf5442b9cd None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:27.039149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf38d1-0010-47b5-a3fc-58cf5442b9cd None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:27.039149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf38d1-0010-47b5-a3fc-58cf5442b9cd None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:27.040024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 156/302] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:27.048614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba342e-6e56-4402-8832-d34e492f9019 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:27.048905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba342e-6e56-4402-8832-d34e492f9019 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:27.049220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba342e-6e56-4402-8832-d34e492f9019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:27.066137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-bbba342e-6e56-4402-8832-d34e492f9019 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:27.067602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-bbba342e-6e56-4402-8832-d34e492f9019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:27.075834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08797b-f79d-438f-ba52-5181efb76ecc None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:27.109316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cedb56-549d-4f78-a98b-4a3cf09fe86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:27.110178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cedb56-549d-4f78-a98b-4a3cf09fe86c None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:27.110462 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cedb56-549d-4f78-a98b-4a3cf09fe86c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:27.110738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cedb56-549d-4f78-a98b-4a3cf09fe86c None admin] PATH_INFO: `/v3/system/users/4d4ac29582de4d6496e87d8e1c745f99/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:27.112292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cedb56-549d-4f78-a98b-4a3cf09fe86c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4d4ac29582de4d6496e87d8e1c745f99, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:27.113696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cedb56-549d-4f78-a98b-4a3cf09fe86c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:27.135942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 157/303] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:27.136975 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba342e-6e56-4402-8832-d34e492f9019 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:27.202307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 147/304] 10.222.0.64 () {58 vars in 1334 bytes} [Fri May 13 17:07:26 2022] PUT /identity/v3/system/users/4d4ac29582de4d6496e87d8e1c745f99/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:07:27.203245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cedb56-549d-4f78-a98b-4a3cf09fe86c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:27.240736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba342e-6e56-4402-8832-d34e492f9019 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:27.279512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd92832-b920-4829-b491-fef2bd78debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:27.280608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd92832-b920-4829-b491-fef2bd78debc None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:27.281041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd92832-b920-4829-b491-fef2bd78debc None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:27.281465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd92832-b920-4829-b491-fef2bd78debc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:27.293431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd92832-b920-4829-b491-fef2bd78debc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-5dd92832-b920-4829-b491-fef2bd78debc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:27.302291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:27.303472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:27.304431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:27.306386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 158/305] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:27.312343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd92832-b920-4829-b491-fef2bd78debc None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:27.323802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cedb56-549d-4f78-a98b-4a3cf09fe86c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:27.359834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f79fd2-cf33-418e-970d-8c47bff7c0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:27.360903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f79fd2-cf33-418e-970d-8c47bff7c0aa None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:27.361331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f79fd2-cf33-418e-970d-8c47bff7c0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:27.362294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f79fd2-cf33-418e-970d-8c47bff7c0aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:27.363753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f79fd2-cf33-418e-970d-8c47bff7c0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:27.365394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f79fd2-cf33-418e-970d-8c47bff7c0aa None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:27.367599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 148/306] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:27.383167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f79fd2-cf33-418e-970d-8c47bff7c0aa None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:27.418225 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd92832-b920-4829-b491-fef2bd78debc None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:27.453065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ba5e-9cdd-4563-b8ee-28100edf2a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:27.453659 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ba5e-9cdd-4563-b8ee-28100edf2a21 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:27.453943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ba5e-9cdd-4563-b8ee-28100edf2a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:27.454217 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ba5e-9cdd-4563-b8ee-28100edf2a21 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:27.454962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1ba5e-9cdd-4563-b8ee-28100edf2a21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:27.455301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1ba5e-9cdd-4563-b8ee-28100edf2a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:27.456722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1ba5e-9cdd-4563-b8ee-28100edf2a21 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:27.465008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 159/307] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:27.470498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ba5e-9cdd-4563-b8ee-28100edf2a21 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:27.478058 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f79fd2-cf33-418e-970d-8c47bff7c0aa None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:27.512658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402f71d-bf88-4e34-ba8e-f5b3ec256722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:27.513335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f71d-bf88-4e34-ba8e-f5b3ec256722 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:27.513619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f71d-bf88-4e34-ba8e-f5b3ec256722 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:27.513895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f71d-bf88-4e34-ba8e-f5b3ec256722 None admin] PATH_INFO: `/v3/groups` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:27.514593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402f71d-bf88-4e34-ba8e-f5b3ec256722 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:27.516098 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402f71d-bf88-4e34-ba8e-f5b3ec256722 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:27.571065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ba5e-9cdd-4563-b8ee-28100edf2a21 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:27.584455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 149/308] 10.222.0.64 () {60 vars in 1134 bytes} [Fri May 13 17:07:27 2022] POST /identity/v3/groups => generated 229 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:07:27.608683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6a5ef-f26b-42f1-9ed2-275d89528a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:27.609611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6a5ef-f26b-42f1-9ed2-275d89528a17 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:27.609897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6a5ef-f26b-42f1-9ed2-275d89528a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:27.610176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6a5ef-f26b-42f1-9ed2-275d89528a17 None admin] PATH_INFO: `/v3/users/d4356e9c5301484895c747164f526c92` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:27.629170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6a5ef-f26b-42f1-9ed2-275d89528a17 None admin] RBAC: Authorizing `identity:get_user(user_id=d4356e9c5301484895c747164f526c92)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:27.630954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6a5ef-f26b-42f1-9ed2-275d89528a17 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:27.633456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 160/309] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:27 2022] GET /identity/v3/users/d4356e9c5301484895c747164f526c92 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:27.639265 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402f71d-bf88-4e34-ba8e-f5b3ec256722 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:27.754720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402f71d-bf88-4e34-ba8e-f5b3ec256722 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:27.793946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0462be-66e3-4d26-af95-c30f9d94db9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:27.794616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0462be-66e3-4d26-af95-c30f9d94db9b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:27.794907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0462be-66e3-4d26-af95-c30f9d94db9b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:27.795265 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0462be-66e3-4d26-af95-c30f9d94db9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:27.796114 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0462be-66e3-4d26-af95-c30f9d94db9b None admin] RBAC: Adding query filter params (role.id=857d25aa9bd04e0b90ba9a17aba49c51, user.id=d4356e9c5301484895c747164f526c92, scope.system=all) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:27.796425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0462be-66e3-4d26-af95-c30f9d94db9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:27.797906 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0462be-66e3-4d26-af95-c30f9d94db9b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:27.804325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 150/310] 10.222.0.64 () {56 vars in 1308 bytes} [Fri May 13 17:07:27 2022] GET /identity/v3/role_assignments?user.id=d4356e9c5301484895c747164f526c92&scope.system=all&role.id=857d25aa9bd04e0b90ba9a17aba49c51 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:27.838697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9661e1-5009-4988-bb3d-a9bae4ec5244 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:27.838988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9661e1-5009-4988-bb3d-a9bae4ec5244 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:27.839300 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9661e1-5009-4988-bb3d-a9bae4ec5244 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:27.840737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 161/311] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:27.847008 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677180c-0fda-4f63-a9d0-f548605fe198 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:27.847376 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677180c-0fda-4f63-a9d0-f548605fe198 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:27.847611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677180c-0fda-4f63-a9d0-f548605fe198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:27.865126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2677180c-0fda-4f63-a9d0-f548605fe198 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:27.866496 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2677180c-0fda-4f63-a9d0-f548605fe198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:27.940353 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 151/312] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:27.964842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9661e1-5009-4988-bb3d-a9bae4ec5244 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:28.071181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9661e1-5009-4988-bb3d-a9bae4ec5244 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:28.107137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311308f-6146-45be-9345-b7f0856ffd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:28.107961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311308f-6146-45be-9345-b7f0856ffd16 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:28.108242 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311308f-6146-45be-9345-b7f0856ffd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:28.108518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311308f-6146-45be-9345-b7f0856ffd16 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:28.119504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311308f-6146-45be-9345-b7f0856ffd16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-4311308f-6146-45be-9345-b7f0856ffd16 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:28.127337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:28.128248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:28.129029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:28.133368 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 162/313] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:28.134770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677180c-0fda-4f63-a9d0-f548605fe198 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:28.233317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677180c-0fda-4f63-a9d0-f548605fe198 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:28.271941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7d6a3-3b7e-47e7-b7b6-0838da4b2ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:28.272626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7d6a3-3b7e-47e7-b7b6-0838da4b2ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:28.272904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7d6a3-3b7e-47e7-b7b6-0838da4b2ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:28.273177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7d6a3-3b7e-47e7-b7b6-0838da4b2ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:28.273924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7d6a3-3b7e-47e7-b7b6-0838da4b2ee6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:28.274227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7d6a3-3b7e-47e7-b7b6-0838da4b2ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:28.275657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7d6a3-3b7e-47e7-b7b6-0838da4b2ee6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:28.284098 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 152/314] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:28.289408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311308f-6146-45be-9345-b7f0856ffd16 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:28.389155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311308f-6146-45be-9345-b7f0856ffd16 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:28.422362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91439b98-e788-4a26-9a8f-96849ff63bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:28.423306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91439b98-e788-4a26-9a8f-96849ff63bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:28.423593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91439b98-e788-4a26-9a8f-96849ff63bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:28.423872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91439b98-e788-4a26-9a8f-96849ff63bb4 None admin] PATH_INFO: `/v3/users/2bd21cae0ad144be846afb5dca3d2b4f` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:28.425782 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91439b98-e788-4a26-9a8f-96849ff63bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=2bd21cae0ad144be846afb5dca3d2b4f)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:28.427336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91439b98-e788-4a26-9a8f-96849ff63bb4 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:28.429435 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 163/315] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:28 2022] GET /identity/v3/users/2bd21cae0ad144be846afb5dca3d2b4f => generated 297 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:28.435120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7d6a3-3b7e-47e7-b7b6-0838da4b2ee6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:28.537036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7d6a3-3b7e-47e7-b7b6-0838da4b2ee6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:28.575301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23831b45-d1fd-43ba-bfc7-fe3037f79f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:28.576563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23831b45-d1fd-43ba-bfc7-fe3037f79f66 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:28.576900 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23831b45-d1fd-43ba-bfc7-fe3037f79f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:28.577190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23831b45-d1fd-43ba-bfc7-fe3037f79f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:28.648289 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23831b45-d1fd-43ba-bfc7-fe3037f79f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:28.649709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23831b45-d1fd-43ba-bfc7-fe3037f79f66 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:28.748327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 153/316] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:28.754479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91439b98-e788-4a26-9a8f-96849ff63bb4 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:28.853747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91439b98-e788-4a26-9a8f-96849ff63bb4 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:28.887882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d086b-5325-481a-8838-5f8b03aea563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:28.888751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d086b-5325-481a-8838-5f8b03aea563 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:28.889036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d086b-5325-481a-8838-5f8b03aea563 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:28.889313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d086b-5325-481a-8838-5f8b03aea563 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:28.890508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d086b-5325-481a-8838-5f8b03aea563 None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:28.892041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d086b-5325-481a-8838-5f8b03aea563 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:28.894007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 164/317] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:28 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:28.899633 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23831b45-d1fd-43ba-bfc7-fe3037f79f66 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:29.000503 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23831b45-d1fd-43ba-bfc7-fe3037f79f66 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:29.036238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab60b-d417-462b-b1e7-cfee91ccce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:29.036903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab60b-d417-462b-b1e7-cfee91ccce7f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:29.037480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab60b-d417-462b-b1e7-cfee91ccce7f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:29.037772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab60b-d417-462b-b1e7-cfee91ccce7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:29.038608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab60b-d417-462b-b1e7-cfee91ccce7f None admin] RBAC: Adding query filter params (role.id=857d25aa9bd04e0b90ba9a17aba49c51, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4, user.id=2bd21cae0ad144be846afb5dca3d2b4f) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:29.038920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab60b-d417-462b-b1e7-cfee91ccce7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:29.040455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab60b-d417-462b-b1e7-cfee91ccce7f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:29.047144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 154/318] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:28 2022] GET /identity/v3/role_assignments?user.id=2bd21cae0ad144be846afb5dca3d2b4f&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=857d25aa9bd04e0b90ba9a17aba49c51 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:29.562377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91110113-9a64-43ee-a389-14a1e7c24e5c None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:29.562729 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91110113-9a64-43ee-a389-14a1e7c24e5c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:29.562952 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91110113-9a64-43ee-a389-14a1e7c24e5c None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:29.564389 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 165/319] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:29.569567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbca0e-285f-474d-a530-0eda28163e8d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:29.570001 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbca0e-285f-474d-a530-0eda28163e8d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:29.570180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbca0e-285f-474d-a530-0eda28163e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:29.587200 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2edbca0e-285f-474d-a530-0eda28163e8d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:29.588390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2edbca0e-285f-474d-a530-0eda28163e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:29.651963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 155/320] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:29.675593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91110113-9a64-43ee-a389-14a1e7c24e5c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:29.777351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91110113-9a64-43ee-a389-14a1e7c24e5c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:29.809727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc831da-ac50-45c0-af81-0795d59d16e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:29.810528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc831da-ac50-45c0-af81-0795d59d16e5 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:29.810815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc831da-ac50-45c0-af81-0795d59d16e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:29.811092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc831da-ac50-45c0-af81-0795d59d16e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:29.820966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc831da-ac50-45c0-af81-0795d59d16e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-8dc831da-ac50-45c0-af81-0795d59d16e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:29.828953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:29.829798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:29.831118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:29.835325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 166/321] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:29.836494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbca0e-285f-474d-a530-0eda28163e8d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:29.930323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211efa42-afee-4399-836a-7376df3a45db None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:29.930323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211efa42-afee-4399-836a-7376df3a45db None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:29.930885 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211efa42-afee-4399-836a-7376df3a45db None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:29.931805 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbca0e-285f-474d-a530-0eda28163e8d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:29.932488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 167/322] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:29.937218 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d632c3-e124-442d-82f2-d10d4bbc4985 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:29.937508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d632c3-e124-442d-82f2-d10d4bbc4985 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:29.937788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d632c3-e124-442d-82f2-d10d4bbc4985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:29.954167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-22d632c3-e124-442d-82f2-d10d4bbc4985 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:29.955398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-22d632c3-e124-442d-82f2-d10d4bbc4985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:29.969205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1895bb0-4106-4bed-8ccd-b7f36ae43e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:29.970813 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895bb0-4106-4bed-8ccd-b7f36ae43e3b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:29.971928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895bb0-4106-4bed-8ccd-b7f36ae43e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:29.972214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895bb0-4106-4bed-8ccd-b7f36ae43e3b None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:29.973012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1895bb0-4106-4bed-8ccd-b7f36ae43e3b None admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:29.973324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1895bb0-4106-4bed-8ccd-b7f36ae43e3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:29.974791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1895bb0-4106-4bed-8ccd-b7f36ae43e3b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:29.984210 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 156/323] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:29.990850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1895bb0-4106-4bed-8ccd-b7f36ae43e3b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:30.031391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 168/324] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:30.054559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d632c3-e124-442d-82f2-d10d4bbc4985 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:30.136996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1895bb0-4106-4bed-8ccd-b7f36ae43e3b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:30.169830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd057f6-621e-4581-a36c-02a5f55b93f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:30.170695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd057f6-621e-4581-a36c-02a5f55b93f0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:30.170970 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd057f6-621e-4581-a36c-02a5f55b93f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:30.171270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd057f6-621e-4581-a36c-02a5f55b93f0 None admin] PATH_INFO: `/v3/users/4d4ac29582de4d6496e87d8e1c745f99` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:30.172429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd057f6-621e-4581-a36c-02a5f55b93f0 None admin] RBAC: Authorizing `identity:get_user(user_id=4d4ac29582de4d6496e87d8e1c745f99)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:30.173880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd057f6-621e-4581-a36c-02a5f55b93f0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:30.176146 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 157/325] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:29 2022] GET /identity/v3/users/4d4ac29582de4d6496e87d8e1c745f99 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:30.177298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ee66-85cd-4f6d-9b37-541be130265a None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:30.177400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d632c3-e124-442d-82f2-d10d4bbc4985 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:30.177578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ee66-85cd-4f6d-9b37-541be130265a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:30.177848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ee66-85cd-4f6d-9b37-541be130265a None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:30.182048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 158/326] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:30.182048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ee66-85cd-4f6d-9b37-541be130265a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:30.215954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3addf-bdb3-4a70-b3c7-1ae1f31e4fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:30.216747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3addf-bdb3-4a70-b3c7-1ae1f31e4fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:30.217032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3addf-bdb3-4a70-b3c7-1ae1f31e4fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:30.217306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3addf-bdb3-4a70-b3c7-1ae1f31e4fd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:30.218551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3addf-bdb3-4a70-b3c7-1ae1f31e4fd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:30.220052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3addf-bdb3-4a70-b3c7-1ae1f31e4fd5 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:30.222223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 169/327] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:30.223384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db65ae-ab0f-43c3-a64d-b8319451e563 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:30.223670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db65ae-ab0f-43c3-a64d-b8319451e563 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:30.223954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db65ae-ab0f-43c3-a64d-b8319451e563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:30.240464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-57db65ae-ab0f-43c3-a64d-b8319451e563 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:30.241644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-57db65ae-ab0f-43c3-a64d-b8319451e563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:30.277859 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ee66-85cd-4f6d-9b37-541be130265a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:30.303357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 170/328] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:30.303961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db65ae-ab0f-43c3-a64d-b8319451e563 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:30.309024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c86ddf-97f8-485f-8ac6-9e21e68ca1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:30.309668 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c86ddf-97f8-485f-8ac6-9e21e68ca1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:30.309944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c86ddf-97f8-485f-8ac6-9e21e68ca1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:30.310214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c86ddf-97f8-485f-8ac6-9e21e68ca1d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:30.311031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c86ddf-97f8-485f-8ac6-9e21e68ca1d7 None admin] RBAC: Adding query filter params (role.id=52bafac2651a4075879b7d97a4f9111e, user.id=4d4ac29582de4d6496e87d8e1c745f99, scope.system=all) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:30.311382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c86ddf-97f8-485f-8ac6-9e21e68ca1d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:30.312811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c86ddf-97f8-485f-8ac6-9e21e68ca1d7 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:30.324499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 159/329] 10.222.0.64 () {56 vars in 1308 bytes} [Fri May 13 17:07:30 2022] GET /identity/v3/role_assignments?user.id=4d4ac29582de4d6496e87d8e1c745f99&scope.system=all&role.id=52bafac2651a4075879b7d97a4f9111e => generated 510 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:30.325651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c86ddf-97f8-485f-8ac6-9e21e68ca1d7 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:30.410579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db65ae-ab0f-43c3-a64d-b8319451e563 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:30.438544 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c86ddf-97f8-485f-8ac6-9e21e68ca1d7 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:30.446312 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c373e9-a55a-4de8-abdb-84ef4b4102d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:30.447001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c373e9-a55a-4de8-abdb-84ef4b4102d7 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:30.447323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c373e9-a55a-4de8-abdb-84ef4b4102d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:30.447603 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c373e9-a55a-4de8-abdb-84ef4b4102d7 None admin] PATH_INFO: `/v3/groups` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:30.448304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c373e9-a55a-4de8-abdb-84ef4b4102d7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:30.450078 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c373e9-a55a-4de8-abdb-84ef4b4102d7 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:30.473897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648e6e-3ea6-43d6-9e31-69f97ae8a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:30.474694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648e6e-3ea6-43d6-9e31-69f97ae8a5ad None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:30.474975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648e6e-3ea6-43d6-9e31-69f97ae8a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:30.475282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648e6e-3ea6-43d6-9e31-69f97ae8a5ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:30.486060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0648e6e-3ea6-43d6-9e31-69f97ae8a5ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d0648e6e-3ea6-43d6-9e31-69f97ae8a5ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:30.494472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:30.495752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:30.496560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 160/330] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:30.501621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648e6e-3ea6-43d6-9e31-69f97ae8a5ad None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:30.600601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648e6e-3ea6-43d6-9e31-69f97ae8a5ad None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:30.633380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c0d4d-c00f-404c-a8de-4255f5e92cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:30.634040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c0d4d-c00f-404c-a8de-4255f5e92cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:30.634325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c0d4d-c00f-404c-a8de-4255f5e92cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:30.634604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c0d4d-c00f-404c-a8de-4255f5e92cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:30.635371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c0d4d-c00f-404c-a8de-4255f5e92cf6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:30.635679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c0d4d-c00f-404c-a8de-4255f5e92cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:30.637142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c0d4d-c00f-404c-a8de-4255f5e92cf6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:30.645356 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 161/331] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:30.650796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c0d4d-c00f-404c-a8de-4255f5e92cf6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:30.690990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 171/332] 10.222.0.64 () {60 vars in 1134 bytes} [Fri May 13 17:07:30 2022] POST /identity/v3/groups => generated 226 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:07:30.773182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c0d4d-c00f-404c-a8de-4255f5e92cf6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:30.807001 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132588ac-56e9-4bae-8d94-1f7e8f394f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:30.807914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132588ac-56e9-4bae-8d94-1f7e8f394f79 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:30.808194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132588ac-56e9-4bae-8d94-1f7e8f394f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:30.808464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132588ac-56e9-4bae-8d94-1f7e8f394f79 None admin] PATH_INFO: `/v3/users/d4356e9c5301484895c747164f526c92` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:30.809670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132588ac-56e9-4bae-8d94-1f7e8f394f79 None admin] RBAC: Authorizing `identity:get_user(user_id=d4356e9c5301484895c747164f526c92)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:30.811165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132588ac-56e9-4bae-8d94-1f7e8f394f79 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:30.813061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 162/333] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:30 2022] GET /identity/v3/users/d4356e9c5301484895c747164f526c92 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:30.819001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c373e9-a55a-4de8-abdb-84ef4b4102d7 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:30.917149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c373e9-a55a-4de8-abdb-84ef4b4102d7 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:30.949790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c96c7c-ed24-4d31-954a-c8cc8660a27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:30.950593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c96c7c-ed24-4d31-954a-c8cc8660a27a None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:30.950877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c96c7c-ed24-4d31-954a-c8cc8660a27a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:30.951180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c96c7c-ed24-4d31-954a-c8cc8660a27a None admin] PATH_INFO: `/v3/system/users/d4356e9c5301484895c747164f526c92/roles/857d25aa9bd04e0b90ba9a17aba49c51` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:30.952698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c96c7c-ed24-4d31-954a-c8cc8660a27a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d4356e9c5301484895c747164f526c92, role_id=857d25aa9bd04e0b90ba9a17aba49c51)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:30.954099 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c96c7c-ed24-4d31-954a-c8cc8660a27a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:31.033495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 172/334] 10.222.0.64 () {58 vars in 1334 bytes} [Fri May 13 17:07:30 2022] PUT /identity/v3/system/users/d4356e9c5301484895c747164f526c92/roles/857d25aa9bd04e0b90ba9a17aba49c51 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:33.300664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe91a2d-2c43-4a53-9983-3bda81cb39c1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:33.301671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe91a2d-2c43-4a53-9983-3bda81cb39c1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:33.302177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe91a2d-2c43-4a53-9983-3bda81cb39c1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:33.303802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 163/335] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:33.309568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f41e1-12c7-4e2a-a49c-46abfb2ff3a1 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:33.310519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f41e1-12c7-4e2a-a49c-46abfb2ff3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:33.311028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f41e1-12c7-4e2a-a49c-46abfb2ff3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:33.340379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-373f41e1-12c7-4e2a-a49c-46abfb2ff3a1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:33.342003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-373f41e1-12c7-4e2a-a49c-46abfb2ff3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:33.423030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 173/336] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:33.463546 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe91a2d-2c43-4a53-9983-3bda81cb39c1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:33.596560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe91a2d-2c43-4a53-9983-3bda81cb39c1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:33.635285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c44bb-b543-4a98-80bf-23aa18933405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:33.636099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c44bb-b543-4a98-80bf-23aa18933405 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:33.636378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c44bb-b543-4a98-80bf-23aa18933405 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:33.636651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c44bb-b543-4a98-80bf-23aa18933405 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:33.656037 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c44bb-b543-4a98-80bf-23aa18933405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:33.669048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ad536-1efd-49dd-a361-00020511bdb9 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:33.669691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ad536-1efd-49dd-a361-00020511bdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d69c44bb-b543-4a98-80bf-23aa18933405 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:33.669806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:33.670641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:33.671461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 164/337] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:33.672939 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ad536-1efd-49dd-a361-00020511bdb9 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:33.679506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 174/338] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:33.684050 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c44bb-b543-4a98-80bf-23aa18933405 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:33.684871 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09617a0b-8a84-4a2e-92a6-4be996ef47e1 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:33.685382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09617a0b-8a84-4a2e-92a6-4be996ef47e1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:33.685870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09617a0b-8a84-4a2e-92a6-4be996ef47e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:33.720126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-09617a0b-8a84-4a2e-92a6-4be996ef47e1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:33.722281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-09617a0b-8a84-4a2e-92a6-4be996ef47e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:33.811075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c44bb-b543-4a98-80bf-23aa18933405 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:33.853173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfbb2d-04cf-4c81-8681-9d67fd1d9953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:33.855234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbb2d-04cf-4c81-8681-9d67fd1d9953 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:33.855742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbb2d-04cf-4c81-8681-9d67fd1d9953 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:33.856896 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbb2d-04cf-4c81-8681-9d67fd1d9953 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:33.857863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfbb2d-04cf-4c81-8681-9d67fd1d9953 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:33.858928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfbb2d-04cf-4c81-8681-9d67fd1d9953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:33.860746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfbb2d-04cf-4c81-8681-9d67fd1d9953 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:33.869728 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 175/339] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:33.878551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 165/340] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:33.884229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09617a0b-8a84-4a2e-92a6-4be996ef47e1 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:33.914641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfbb2d-04cf-4c81-8681-9d67fd1d9953 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:34.046116 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfbb2d-04cf-4c81-8681-9d67fd1d9953 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:34.087905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09617a0b-8a84-4a2e-92a6-4be996ef47e1 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:34.090890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edfd21-c35d-496f-b897-b0a6a123104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:34.091774 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edfd21-c35d-496f-b897-b0a6a123104f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:34.092057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edfd21-c35d-496f-b897-b0a6a123104f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:34.092334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edfd21-c35d-496f-b897-b0a6a123104f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:34.115872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edfd21-c35d-496f-b897-b0a6a123104f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-c7edfd21-c35d-496f-b897-b0a6a123104f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:34.123831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:34.124753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:34.125539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:34.127925 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 166/341] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:34.135948 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2d16-18f5-43b8-8f7b-43e04c6ddeea None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:34.141164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2d16-18f5-43b8-8f7b-43e04c6ddeea None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:34.141164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2d16-18f5-43b8-8f7b-43e04c6ddeea None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:34.141164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 167/342] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:34.141164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2d16-18f5-43b8-8f7b-43e04c6ddeea None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:34.164783 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9f37e-f95f-4d17-a209-64ef3e930b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:34.165486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f37e-f95f-4d17-a209-64ef3e930b3a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:34.166071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f37e-f95f-4d17-a209-64ef3e930b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:34.166071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f37e-f95f-4d17-a209-64ef3e930b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:34.272487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9f37e-f95f-4d17-a209-64ef3e930b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:34.274368 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9f37e-f95f-4d17-a209-64ef3e930b3a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:34.298063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2d16-18f5-43b8-8f7b-43e04c6ddeea None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:34.335296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95286367-9dab-4e39-939b-e585e9104109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:34.335953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286367-9dab-4e39-939b-e585e9104109 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:34.336230 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286367-9dab-4e39-939b-e585e9104109 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:34.336675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286367-9dab-4e39-939b-e585e9104109 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:34.337692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95286367-9dab-4e39-939b-e585e9104109 None admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:34.338154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95286367-9dab-4e39-939b-e585e9104109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:34.339809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95286367-9dab-4e39-939b-e585e9104109 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:34.350270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 168/343] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:34.352103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11575-0956-4723-a362-08c8d20fe68d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:34.352664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11575-0956-4723-a362-08c8d20fe68d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:34.353142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11575-0956-4723-a362-08c8d20fe68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:34.371214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-01b11575-0956-4723-a362-08c8d20fe68d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:34.372845 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-01b11575-0956-4723-a362-08c8d20fe68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:34.378749 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 176/344] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 17:07:34.385500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad31fb-f81f-4e7d-9a90-a954f582620e None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:34.385800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad31fb-f81f-4e7d-9a90-a954f582620e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:34.386328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad31fb-f81f-4e7d-9a90-a954f582620e None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:34.387450 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 177/345] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:34.388164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad31fb-f81f-4e7d-9a90-a954f582620e None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:34.446844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 169/346] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:34.448259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b11575-0956-4723-a362-08c8d20fe68d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:34.498182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad31fb-f81f-4e7d-9a90-a954f582620e None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:34.533973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58faba72-2280-4461-bfa0-3392248eea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:34.534665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faba72-2280-4461-bfa0-3392248eea52 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:34.534952 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faba72-2280-4461-bfa0-3392248eea52 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:34.535277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faba72-2280-4461-bfa0-3392248eea52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:34.552846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b11575-0956-4723-a362-08c8d20fe68d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:34.590093 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cfb8b-74c0-4093-b213-7b5be3c0fdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:34.591397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cfb8b-74c0-4093-b213-7b5be3c0fdec None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:34.591909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cfb8b-74c0-4093-b213-7b5be3c0fdec None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:34.592400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cfb8b-74c0-4093-b213-7b5be3c0fdec None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:34.593812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cfb8b-74c0-4093-b213-7b5be3c0fdec None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:34.595537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cfb8b-74c0-4093-b213-7b5be3c0fdec None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:34.597644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 170/347] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:34 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:34.599248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f8884-6b0c-468c-b325-443016cb36db None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:34.599745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f8884-6b0c-468c-b325-443016cb36db None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:34.600221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f8884-6b0c-468c-b325-443016cb36db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:34.605973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58faba72-2280-4461-bfa0-3392248eea52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:34.607644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58faba72-2280-4461-bfa0-3392248eea52 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:34.622481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-528f8884-6b0c-468c-b325-443016cb36db None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:34.624106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-528f8884-6b0c-468c-b325-443016cb36db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:34.700389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 171/348] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:34.701632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f8884-6b0c-468c-b325-443016cb36db None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:34.720034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 178/349] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:34.720975 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58faba72-2280-4461-bfa0-3392248eea52 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:34.810290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f8884-6b0c-468c-b325-443016cb36db None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:34.838974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58faba72-2280-4461-bfa0-3392248eea52 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:34.846857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f44a1-3404-4613-9d50-2b357a111eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:34.848011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f44a1-3404-4613-9d50-2b357a111eab None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:34.848516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f44a1-3404-4613-9d50-2b357a111eab None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:34.849007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f44a1-3404-4613-9d50-2b357a111eab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:34.860074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f44a1-3404-4613-9d50-2b357a111eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-508f44a1-3404-4613-9d50-2b357a111eab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:34.868947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:34.869880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 17:07:34.870691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:34.873177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 172/350] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:34.874030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ad784-7ff2-476b-9e1a-2222139e8aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:34.874557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f44a1-3404-4613-9d50-2b357a111eab None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:34.875074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ad784-7ff2-476b-9e1a-2222139e8aef None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:34.875443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ad784-7ff2-476b-9e1a-2222139e8aef None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:34.875817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ad784-7ff2-476b-9e1a-2222139e8aef None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:34.882709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ad784-7ff2-476b-9e1a-2222139e8aef None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:34.884335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ad784-7ff2-476b-9e1a-2222139e8aef None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:34.886130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 179/351] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:34 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:34.887012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ad784-7ff2-476b-9e1a-2222139e8aef None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:34.981498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f44a1-3404-4613-9d50-2b357a111eab None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:35.010251 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ad784-7ff2-476b-9e1a-2222139e8aef None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:35.017846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eff71-9a6e-49c4-a30e-e3cb24d6b231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:35.018957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eff71-9a6e-49c4-a30e-e3cb24d6b231 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.019471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eff71-9a6e-49c4-a30e-e3cb24d6b231 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.019949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eff71-9a6e-49c4-a30e-e3cb24d6b231 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.021477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eff71-9a6e-49c4-a30e-e3cb24d6b231 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:35.023254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eff71-9a6e-49c4-a30e-e3cb24d6b231 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:35.025650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 173/352] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:34 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:35.026777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eff71-9a6e-49c4-a30e-e3cb24d6b231 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:35.035943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c157-8cc2-4f54-9a57-91403ff9053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:35.036728 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c157-8cc2-4f54-9a57-91403ff9053e None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.037914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c157-8cc2-4f54-9a57-91403ff9053e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.037914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c157-8cc2-4f54-9a57-91403ff9053e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.050031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5c157-8cc2-4f54-9a57-91403ff9053e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-15e5c157-8cc2-4f54-9a57-91403ff9053e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:35.058246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:35.059246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 180/353] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:35.060514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c157-8cc2-4f54-9a57-91403ff9053e None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:35.141302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eff71-9a6e-49c4-a30e-e3cb24d6b231 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:35.169055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c157-8cc2-4f54-9a57-91403ff9053e None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:35.181891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32396a30-e7b6-40b0-b511-28ed6945b04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:35.182921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32396a30-e7b6-40b0-b511-28ed6945b04e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.183452 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32396a30-e7b6-40b0-b511-28ed6945b04e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.183949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32396a30-e7b6-40b0-b511-28ed6945b04e None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.184923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32396a30-e7b6-40b0-b511-28ed6945b04e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:35.185430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32396a30-e7b6-40b0-b511-28ed6945b04e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:35.187056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32396a30-e7b6-40b0-b511-28ed6945b04e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:35.198905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 174/354] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:35.202300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32396a30-e7b6-40b0-b511-28ed6945b04e None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:35.204634 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8f6b0-5bd3-4f33-8331-797fed1ee1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:35.205328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8f6b0-5bd3-4f33-8331-797fed1ee1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.205618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8f6b0-5bd3-4f33-8331-797fed1ee1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.205896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8f6b0-5bd3-4f33-8331-797fed1ee1a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.206755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8f6b0-5bd3-4f33-8331-797fed1ee1a2 None admin] RBAC: Adding query filter params (group.id=5e51afed6cda444baa050d64eea4e5cc, role.id=1efabb1110d64eebacd85d9016d7d286, scope.project.id=17128730ad3c43e194e508cc0fcd24cb) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:35.207077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8f6b0-5bd3-4f33-8331-797fed1ee1a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:35.209811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8f6b0-5bd3-4f33-8331-797fed1ee1a2 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:35.216004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 181/355] 10.222.0.64 () {56 vars in 1376 bytes} [Fri May 13 17:07:35 2022] GET /identity/v3/role_assignments?group.id=5e51afed6cda444baa050d64eea4e5cc&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=1efabb1110d64eebacd85d9016d7d286 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:35.216637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8f6b0-5bd3-4f33-8331-797fed1ee1a2 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:35.322530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32396a30-e7b6-40b0-b511-28ed6945b04e None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:35.361564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4cdda-5773-44bc-90a9-4d4d628849cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:35.363858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4cdda-5773-44bc-90a9-4d4d628849cd None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.364349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4cdda-5773-44bc-90a9-4d4d628849cd None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.364890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4cdda-5773-44bc-90a9-4d4d628849cd None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.366419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4cdda-5773-44bc-90a9-4d4d628849cd None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:35.368201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4cdda-5773-44bc-90a9-4d4d628849cd None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:35.370157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 175/356] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:35 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:35.371359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4cdda-5773-44bc-90a9-4d4d628849cd None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:35.375853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8f6b0-5bd3-4f33-8331-797fed1ee1a2 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:35.417615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bffe2-2696-4787-a20e-19573cb63bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:35.418385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bffe2-2696-4787-a20e-19573cb63bad None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.418777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bffe2-2696-4787-a20e-19573cb63bad None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.419188 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bffe2-2696-4787-a20e-19573cb63bad None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.420076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bffe2-2696-4787-a20e-19573cb63bad None admin] RBAC: Adding query filter params (name=member) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:35.420397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bffe2-2696-4787-a20e-19573cb63bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:35.421848 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bffe2-2696-4787-a20e-19573cb63bad None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:35.432401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 182/357] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:35.433737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00473ce-d123-4dc2-89ba-adf0c4c5335f None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.434027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00473ce-d123-4dc2-89ba-adf0c4c5335f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.434308 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00473ce-d123-4dc2-89ba-adf0c4c5335f None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.437037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 183/358] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:35.437037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00473ce-d123-4dc2-89ba-adf0c4c5335f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:35.514219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4cdda-5773-44bc-90a9-4d4d628849cd None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:35.557587 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9284991-6692-4de9-8de4-88023e108ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:35.558571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9284991-6692-4de9-8de4-88023e108ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.558924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9284991-6692-4de9-8de4-88023e108ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.559230 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9284991-6692-4de9-8de4-88023e108ca4 None admin] PATH_INFO: `/v3/users/d4356e9c5301484895c747164f526c92` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.562939 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9284991-6692-4de9-8de4-88023e108ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=d4356e9c5301484895c747164f526c92)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:35.564488 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9284991-6692-4de9-8de4-88023e108ca4 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:35.566231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 176/359] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:07:35 2022] GET /identity/v3/users/d4356e9c5301484895c747164f526c92 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:35.567521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b0a66-1983-4b28-b199-31280b99d302 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.567883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b0a66-1983-4b28-b199-31280b99d302 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.568086 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b0a66-1983-4b28-b199-31280b99d302 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.569382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 177/360] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:35.570084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b0a66-1983-4b28-b199-31280b99d302 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:35.574375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00473ce-d123-4dc2-89ba-adf0c4c5335f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:35.619887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c83806-83fa-4bbc-b62a-665a5457f5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:35.620559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c83806-83fa-4bbc-b62a-665a5457f5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.620847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c83806-83fa-4bbc-b62a-665a5457f5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.621127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c83806-83fa-4bbc-b62a-665a5457f5d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.621973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c83806-83fa-4bbc-b62a-665a5457f5d1 None admin] RBAC: Adding query filter params (group.id=5e51afed6cda444baa050d64eea4e5cc, role.id=52bafac2651a4075879b7d97a4f9111e, scope.project.id=17128730ad3c43e194e508cc0fcd24cb) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:35.622289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c83806-83fa-4bbc-b62a-665a5457f5d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:35.624612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c83806-83fa-4bbc-b62a-665a5457f5d1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:35.633570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 184/361] 10.222.0.64 () {56 vars in 1376 bytes} [Fri May 13 17:07:35 2022] GET /identity/v3/role_assignments?group.id=5e51afed6cda444baa050d64eea4e5cc&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=52bafac2651a4075879b7d97a4f9111e => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:35.634836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c53350-cdc8-4b4c-965c-1c2a083b6678 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.635140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c53350-cdc8-4b4c-965c-1c2a083b6678 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.635443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c53350-cdc8-4b4c-965c-1c2a083b6678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.654945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a6c53350-cdc8-4b4c-965c-1c2a083b6678 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:35.656208 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a6c53350-cdc8-4b4c-965c-1c2a083b6678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:35.710816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b0a66-1983-4b28-b199-31280b99d302 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:35.745748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 185/362] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:35.751405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bad83c-8527-4dce-95e8-8e9972e0db1c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.751774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bad83c-8527-4dce-95e8-8e9972e0db1c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.752062 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bad83c-8527-4dce-95e8-8e9972e0db1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.777921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee17e6-8d77-43ef-9aa9-14d023f0ff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:35.778667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee17e6-8d77-43ef-9aa9-14d023f0ff56 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:35.778957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee17e6-8d77-43ef-9aa9-14d023f0ff56 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:35.779258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee17e6-8d77-43ef-9aa9-14d023f0ff56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:35.780936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c7bad83c-8527-4dce-95e8-8e9972e0db1c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:35.782165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c7bad83c-8527-4dce-95e8-8e9972e0db1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:35.869850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee17e6-8d77-43ef-9aa9-14d023f0ff56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:35.870599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee17e6-8d77-43ef-9aa9-14d023f0ff56 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:35.881455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 186/363] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:35.882324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bad83c-8527-4dce-95e8-8e9972e0db1c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:36.031367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 178/364] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:36.032233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee17e6-8d77-43ef-9aa9-14d023f0ff56 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:36.045491 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bad83c-8527-4dce-95e8-8e9972e0db1c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:36.089666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f4fb1-b455-4e58-8806-6b7b3deb8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:36.090336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f4fb1-b455-4e58-8806-6b7b3deb8548 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:36.090622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f4fb1-b455-4e58-8806-6b7b3deb8548 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:36.090950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f4fb1-b455-4e58-8806-6b7b3deb8548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:36.091836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f4fb1-b455-4e58-8806-6b7b3deb8548 None admin] RBAC: Adding query filter params (role.id=857d25aa9bd04e0b90ba9a17aba49c51, user.id=d4356e9c5301484895c747164f526c92, scope.system=all) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:36.092149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f4fb1-b455-4e58-8806-6b7b3deb8548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:36.093630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f4fb1-b455-4e58-8806-6b7b3deb8548 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:36.107399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 187/365] 10.222.0.64 () {56 vars in 1308 bytes} [Fri May 13 17:07:35 2022] GET /identity/v3/role_assignments?user.id=d4356e9c5301484895c747164f526c92&scope.system=all&role.id=857d25aa9bd04e0b90ba9a17aba49c51 => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:36.108066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f4fb1-b455-4e58-8806-6b7b3deb8548 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:36.145115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee17e6-8d77-43ef-9aa9-14d023f0ff56 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:36.189814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bee84-2eda-45da-ba20-26e3d3ba0bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:36.190634 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bee84-2eda-45da-ba20-26e3d3ba0bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:36.190913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bee84-2eda-45da-ba20-26e3d3ba0bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:36.191208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bee84-2eda-45da-ba20-26e3d3ba0bd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:36.217940 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bee84-2eda-45da-ba20-26e3d3ba0bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-343bee84-2eda-45da-ba20-26e3d3ba0bd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:36.229988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:36.230995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:36.231887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 179/366] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:07:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:36.232564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bee84-2eda-45da-ba20-26e3d3ba0bd6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:36.322375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f4fb1-b455-4e58-8806-6b7b3deb8548 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:36.354081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bee84-2eda-45da-ba20-26e3d3ba0bd6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:36.385141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf78cef-ec1f-46fa-8940-0d74a9311a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:36.386329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf78cef-ec1f-46fa-8940-0d74a9311a10 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:36.386847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf78cef-ec1f-46fa-8940-0d74a9311a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:36.387351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf78cef-ec1f-46fa-8940-0d74a9311a10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:36.396780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd136-6f35-45b8-ac68-9c7869e6d9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:36.398356 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd136-6f35-45b8-ac68-9c7869e6d9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:36.398846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd136-6f35-45b8-ac68-9c7869e6d9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:36.399348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd136-6f35-45b8-ac68-9c7869e6d9f8 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:36.402070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd136-6f35-45b8-ac68-9c7869e6d9f8 None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:36.403942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd136-6f35-45b8-ac68-9c7869e6d9f8 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:36.406253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 180/367] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:36 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:36.411359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd136-6f35-45b8-ac68-9c7869e6d9f8 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:36.414586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf78cef-ec1f-46fa-8940-0d74a9311a10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-6cf78cef-ec1f-46fa-8940-0d74a9311a10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:36.425006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:36.426315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 188/368] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:36.427109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf78cef-ec1f-46fa-8940-0d74a9311a10 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:36.566516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf78cef-ec1f-46fa-8940-0d74a9311a10 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:36.571779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd136-6f35-45b8-ac68-9c7869e6d9f8 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:36.608960 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507a50e-e19b-4396-8998-3fbc8a08456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:36.609699 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507a50e-e19b-4396-8998-3fbc8a08456e None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:36.609983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507a50e-e19b-4396-8998-3fbc8a08456e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:36.610257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507a50e-e19b-4396-8998-3fbc8a08456e None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:36.612777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507a50e-e19b-4396-8998-3fbc8a08456e None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:36.614259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507a50e-e19b-4396-8998-3fbc8a08456e None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:36.616144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 189/369] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:36 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:36.619166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507a50e-e19b-4396-8998-3fbc8a08456e None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:36.621069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f11f3-35a0-4f33-bd01-334e8643e67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:36.621936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f11f3-35a0-4f33-bd01-334e8643e67a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:36.622390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f11f3-35a0-4f33-bd01-334e8643e67a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:36.622823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f11f3-35a0-4f33-bd01-334e8643e67a None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:36.623748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f11f3-35a0-4f33-bd01-334e8643e67a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:36.624202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f11f3-35a0-4f33-bd01-334e8643e67a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:36.625747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f11f3-35a0-4f33-bd01-334e8643e67a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:36.642752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 181/370] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:36.644453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f11f3-35a0-4f33-bd01-334e8643e67a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:36.752744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507a50e-e19b-4396-8998-3fbc8a08456e None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:36.784716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f11f3-35a0-4f33-bd01-334e8643e67a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:36.789958 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018cfe7-ecf8-49fd-85b7-966193a6cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:36.790814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018cfe7-ecf8-49fd-85b7-966193a6cdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:36.791243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018cfe7-ecf8-49fd-85b7-966193a6cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:36.791674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018cfe7-ecf8-49fd-85b7-966193a6cdb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:36.792528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018cfe7-ecf8-49fd-85b7-966193a6cdb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:36.792938 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018cfe7-ecf8-49fd-85b7-966193a6cdb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:36.794419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018cfe7-ecf8-49fd-85b7-966193a6cdb5 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:36.804448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 190/371] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:36.805554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018cfe7-ecf8-49fd-85b7-966193a6cdb5 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:36.825788 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2f202-c2cf-41e7-8e17-7d66a4c60d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:36.826697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2f202-c2cf-41e7-8e17-7d66a4c60d5b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:36.827351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2f202-c2cf-41e7-8e17-7d66a4c60d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:36.827600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2f202-c2cf-41e7-8e17-7d66a4c60d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:36.828450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2f202-c2cf-41e7-8e17-7d66a4c60d5b None admin] RBAC: Adding query filter params (group.id=5e51afed6cda444baa050d64eea4e5cc, role.id=52bafac2651a4075879b7d97a4f9111e, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:36.828769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2f202-c2cf-41e7-8e17-7d66a4c60d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:36.830228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2f202-c2cf-41e7-8e17-7d66a4c60d5b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:36.838453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 182/372] 10.222.0.64 () {56 vars in 1376 bytes} [Fri May 13 17:07:36 2022] GET /identity/v3/role_assignments?group.id=5e51afed6cda444baa050d64eea4e5cc&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=52bafac2651a4075879b7d97a4f9111e => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:36.839546 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2f202-c2cf-41e7-8e17-7d66a4c60d5b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:36.969211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018cfe7-ecf8-49fd-85b7-966193a6cdb5 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:36.974834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2f202-c2cf-41e7-8e17-7d66a4c60d5b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:37.025621 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f2997-b12f-4abe-932c-880ae7d50517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:37.026306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f2997-b12f-4abe-932c-880ae7d50517 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:37.026590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f2997-b12f-4abe-932c-880ae7d50517 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:37.026869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f2997-b12f-4abe-932c-880ae7d50517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:37.039899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6203ba9-6318-4b8a-8d8d-a1590890cc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:37.040579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6203ba9-6318-4b8a-8d8d-a1590890cc87 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:37.040889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6203ba9-6318-4b8a-8d8d-a1590890cc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:37.041256 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6203ba9-6318-4b8a-8d8d-a1590890cc87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:37.147879 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f2997-b12f-4abe-932c-880ae7d50517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:37.149693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f2997-b12f-4abe-932c-880ae7d50517 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:37.168844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6203ba9-6318-4b8a-8d8d-a1590890cc87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:37.171449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6203ba9-6318-4b8a-8d8d-a1590890cc87 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:37.307980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 191/373] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:37.313507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f2997-b12f-4abe-932c-880ae7d50517 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:37.386028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 183/374] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:37.391480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6203ba9-6318-4b8a-8d8d-a1590890cc87 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:37.428231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f2997-b12f-4abe-932c-880ae7d50517 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:37.467870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37284dd-d3ff-4e55-8035-ef54138f4907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:37.469038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37284dd-d3ff-4e55-8035-ef54138f4907 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:37.469691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37284dd-d3ff-4e55-8035-ef54138f4907 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:37.470165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37284dd-d3ff-4e55-8035-ef54138f4907 None admin] PATH_INFO: `/v3/projects/6e1067556b2a41588af4e1e6fd0de9f1` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:37.472120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37284dd-d3ff-4e55-8035-ef54138f4907 None admin] RBAC: Authorizing `identity:get_project(project_id=6e1067556b2a41588af4e1e6fd0de9f1)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:37.473759 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37284dd-d3ff-4e55-8035-ef54138f4907 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:37.476909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 192/375] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:37 2022] GET /identity/v3/projects/6e1067556b2a41588af4e1e6fd0de9f1 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:37.482760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37284dd-d3ff-4e55-8035-ef54138f4907 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:37.564188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6203ba9-6318-4b8a-8d8d-a1590890cc87 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:37.604370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71227d3-856f-4791-86d1-aedbb0b6123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:37.605769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71227d3-856f-4791-86d1-aedbb0b6123d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:37.606303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71227d3-856f-4791-86d1-aedbb0b6123d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:37.606773 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71227d3-856f-4791-86d1-aedbb0b6123d None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:37.608399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71227d3-856f-4791-86d1-aedbb0b6123d None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:37.610209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71227d3-856f-4791-86d1-aedbb0b6123d None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:37.613495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 184/376] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:37 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:37.620298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71227d3-856f-4791-86d1-aedbb0b6123d None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:37.717336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37284dd-d3ff-4e55-8035-ef54138f4907 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:37.740844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71227d3-856f-4791-86d1-aedbb0b6123d None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:37.777657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed30fb6-af19-4c8b-8979-270881c2f1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:37.778811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed30fb6-af19-4c8b-8979-270881c2f1bf None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:37.779471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed30fb6-af19-4c8b-8979-270881c2f1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:37.779959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed30fb6-af19-4c8b-8979-270881c2f1bf None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:37.781584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed30fb6-af19-4c8b-8979-270881c2f1bf None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:37.783280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed30fb6-af19-4c8b-8979-270881c2f1bf None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:37.786691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 185/377] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:37 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:37.793588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed30fb6-af19-4c8b-8979-270881c2f1bf None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:37.812388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d112083-5754-4317-bf54-dc9fd90cf168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:37.813375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d112083-5754-4317-bf54-dc9fd90cf168 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:37.813535 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d112083-5754-4317-bf54-dc9fd90cf168 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:37.813802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d112083-5754-4317-bf54-dc9fd90cf168 None admin] PATH_INFO: `/v3/groups/478bfb4cf5f4444a9f4a2ee5f4ba2134` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:37.833197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d112083-5754-4317-bf54-dc9fd90cf168 None admin] RBAC: Authorizing `identity:get_group(group_id=478bfb4cf5f4444a9f4a2ee5f4ba2134)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:37.834293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d112083-5754-4317-bf54-dc9fd90cf168 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:37.840768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 193/378] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:37 2022] GET /identity/v3/groups/478bfb4cf5f4444a9f4a2ee5f4ba2134 => generated 229 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:37.842080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d112083-5754-4317-bf54-dc9fd90cf168 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:37.911073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed30fb6-af19-4c8b-8979-270881c2f1bf None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:37.950664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bcf71-5c32-4d95-a576-bbaed7a120ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:37.951693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bcf71-5c32-4d95-a576-bbaed7a120ae None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:37.952562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bcf71-5c32-4d95-a576-bbaed7a120ae None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:37.953026 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bcf71-5c32-4d95-a576-bbaed7a120ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:37.959739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bcf71-5c32-4d95-a576-bbaed7a120ae None admin] RBAC: Adding query filter params (group.id=5e51afed6cda444baa050d64eea4e5cc, role.id=1efabb1110d64eebacd85d9016d7d286, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:37.960360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bcf71-5c32-4d95-a576-bbaed7a120ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:37.962642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bcf71-5c32-4d95-a576-bbaed7a120ae None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:37.969813 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 186/379] 10.222.0.64 () {56 vars in 1376 bytes} [Fri May 13 17:07:37 2022] GET /identity/v3/role_assignments?group.id=5e51afed6cda444baa050d64eea4e5cc&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=1efabb1110d64eebacd85d9016d7d286 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:38.060435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3fef1-0f19-4373-b720-91f6efcbcc98 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:38.061342 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3fef1-0f19-4373-b720-91f6efcbcc98 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:38.061830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3fef1-0f19-4373-b720-91f6efcbcc98 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:38.065315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 187/380] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:38.067385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d112083-5754-4317-bf54-dc9fd90cf168 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:38.071646 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c86b8f-9348-4494-b06b-2ade6ba0a4e6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:38.072191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c86b8f-9348-4494-b06b-2ade6ba0a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:38.072774 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c86b8f-9348-4494-b06b-2ade6ba0a4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:38.106803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c09e3-203f-4a19-a55f-ee20148fb3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:38.107434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-20c86b8f-9348-4494-b06b-2ade6ba0a4e6 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:38.107545 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c09e3-203f-4a19-a55f-ee20148fb3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:38.107858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c09e3-203f-4a19-a55f-ee20148fb3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:38.108212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c09e3-203f-4a19-a55f-ee20148fb3f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:38.109152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c09e3-203f-4a19-a55f-ee20148fb3f9 None admin] RBAC: Adding query filter params (group.id=478bfb4cf5f4444a9f4a2ee5f4ba2134, role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=6e1067556b2a41588af4e1e6fd0de9f1) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:38.109536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c09e3-203f-4a19-a55f-ee20148fb3f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:38.109748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-20c86b8f-9348-4494-b06b-2ade6ba0a4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:38.111191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c09e3-203f-4a19-a55f-ee20148fb3f9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:38.118346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 194/381] 10.222.0.64 () {56 vars in 1376 bytes} [Fri May 13 17:07:37 2022] GET /identity/v3/role_assignments?group.id=478bfb4cf5f4444a9f4a2ee5f4ba2134&scope.project.id=6e1067556b2a41588af4e1e6fd0de9f1&role.id=2791519d9bad43318f086666b6e64a20 => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:38.205773 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 188/382] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:38.229640 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c09e3-203f-4a19-a55f-ee20148fb3f9 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:38.351289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c09e3-203f-4a19-a55f-ee20148fb3f9 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:38.394908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbdc99-ca96-4e76-af41-41b8d0c1218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:38.395772 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbdc99-ca96-4e76-af41-41b8d0c1218d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:38.396057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbdc99-ca96-4e76-af41-41b8d0c1218d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:38.396334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbdc99-ca96-4e76-af41-41b8d0c1218d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:38.411650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbdc99-ca96-4e76-af41-41b8d0c1218d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-b1bbdc99-ca96-4e76-af41-41b8d0c1218d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:38.420145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:38.421125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:38.421930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 195/383] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:38.428069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c86b8f-9348-4494-b06b-2ade6ba0a4e6 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:38.476232 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd63fa-e564-4446-b1ac-b255f7e48872 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:38.476756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd63fa-e564-4446-b1ac-b255f7e48872 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:38.476830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd63fa-e564-4446-b1ac-b255f7e48872 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:38.478156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 196/384] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:38.486242 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56108b4-86c4-4776-ae46-111a82b73639 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:38.487423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56108b4-86c4-4776-ae46-111a82b73639 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:38.487909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56108b4-86c4-4776-ae46-111a82b73639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:38.514861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c56108b4-86c4-4776-ae46-111a82b73639 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:38.516353 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c56108b4-86c4-4776-ae46-111a82b73639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:38.554420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c86b8f-9348-4494-b06b-2ade6ba0a4e6 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:38.598444 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5985f1-d881-4363-b704-1e60749b2d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:38.599876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5985f1-d881-4363-b704-1e60749b2d60 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:38.600309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5985f1-d881-4363-b704-1e60749b2d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:38.600760 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5985f1-d881-4363-b704-1e60749b2d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:38.601661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5985f1-d881-4363-b704-1e60749b2d60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:38.602117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5985f1-d881-4363-b704-1e60749b2d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:38.603745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5985f1-d881-4363-b704-1e60749b2d60 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:38.619667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 189/385] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:38.625130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5985f1-d881-4363-b704-1e60749b2d60 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:38.648210 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 197/386] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:38.694573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56108b4-86c4-4776-ae46-111a82b73639 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:38.750296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5985f1-d881-4363-b704-1e60749b2d60 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:38.792673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bfcaf-65b5-4b24-ae12-bd249d8daacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:38.792900 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bfcaf-65b5-4b24-ae12-bd249d8daacd None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:38.793022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bfcaf-65b5-4b24-ae12-bd249d8daacd None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:38.793459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bfcaf-65b5-4b24-ae12-bd249d8daacd None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:38.799829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bfcaf-65b5-4b24-ae12-bd249d8daacd None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:38.801455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bfcaf-65b5-4b24-ae12-bd249d8daacd None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:38.803586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 190/387] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:38 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:38.808551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bfcaf-65b5-4b24-ae12-bd249d8daacd None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:38.832795 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56108b4-86c4-4776-ae46-111a82b73639 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:38.880174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289bf5f-025b-40eb-8dfa-dfab61df4528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:38.881486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289bf5f-025b-40eb-8dfa-dfab61df4528 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:38.882004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289bf5f-025b-40eb-8dfa-dfab61df4528 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:38.882481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289bf5f-025b-40eb-8dfa-dfab61df4528 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:38.904654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289bf5f-025b-40eb-8dfa-dfab61df4528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-4289bf5f-025b-40eb-8dfa-dfab61df4528 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:38.914591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:38.915570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:38.916385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 198/388] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:38.921465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289bf5f-025b-40eb-8dfa-dfab61df4528 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:39.015254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bfcaf-65b5-4b24-ae12-bd249d8daacd None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:39.085093 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76156c1f-39a4-43ad-aebd-98983764ba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:39.086243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156c1f-39a4-43ad-aebd-98983764ba49 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:39.086676 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156c1f-39a4-43ad-aebd-98983764ba49 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:39.087108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156c1f-39a4-43ad-aebd-98983764ba49 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:39.089915 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76156c1f-39a4-43ad-aebd-98983764ba49 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:39.091599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76156c1f-39a4-43ad-aebd-98983764ba49 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:39.097082 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 191/389] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:38 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:39.101607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76156c1f-39a4-43ad-aebd-98983764ba49 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:39.132377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289bf5f-025b-40eb-8dfa-dfab61df4528 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:39.200529 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092326d1-4242-47a7-8bbe-d68ec3dfcdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:39.201461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092326d1-4242-47a7-8bbe-d68ec3dfcdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:39.201903 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092326d1-4242-47a7-8bbe-d68ec3dfcdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:39.202327 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092326d1-4242-47a7-8bbe-d68ec3dfcdb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:39.203315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092326d1-4242-47a7-8bbe-d68ec3dfcdb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:39.203773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092326d1-4242-47a7-8bbe-d68ec3dfcdb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:39.205397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092326d1-4242-47a7-8bbe-d68ec3dfcdb3 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:39.220155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 199/390] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:39.227408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092326d1-4242-47a7-8bbe-d68ec3dfcdb3 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:39.299784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76156c1f-39a4-43ad-aebd-98983764ba49 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:39.368978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024f3c-acbb-47be-b92a-2cadec5305e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:39.369937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024f3c-acbb-47be-b92a-2cadec5305e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:39.370220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024f3c-acbb-47be-b92a-2cadec5305e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:39.370495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024f3c-acbb-47be-b92a-2cadec5305e0 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb/groups/5e51afed6cda444baa050d64eea4e5cc/roles/1efabb1110d64eebacd85d9016d7d286` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:39.371422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092326d1-4242-47a7-8bbe-d68ec3dfcdb3 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:39.379928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd024f3c-acbb-47be-b92a-2cadec5305e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=17128730ad3c43e194e508cc0fcd24cb, group_id=5e51afed6cda444baa050d64eea4e5cc, role_id=1efabb1110d64eebacd85d9016d7d286)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:39.381680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd024f3c-acbb-47be-b92a-2cadec5305e0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:39.416247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da399b-63bc-4928-8bf3-2624afb455e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:39.417615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da399b-63bc-4928-8bf3-2624afb455e8 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:39.418047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da399b-63bc-4928-8bf3-2624afb455e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:39.418474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da399b-63bc-4928-8bf3-2624afb455e8 None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:39.420268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da399b-63bc-4928-8bf3-2624afb455e8 None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:39.422589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da399b-63bc-4928-8bf3-2624afb455e8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:39.426190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 200/391] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:39 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:39.432651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da399b-63bc-4928-8bf3-2624afb455e8 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:39.509502 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 192/392] 10.222.0.64 () {58 vars in 1442 bytes} [Fri May 13 17:07:39 2022] PUT /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb/groups/5e51afed6cda444baa050d64eea4e5cc/roles/1efabb1110d64eebacd85d9016d7d286 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:39.548391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da399b-63bc-4928-8bf3-2624afb455e8 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:39.594929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fb3f9-5967-480c-9298-ef68239af134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:39.595870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb3f9-5967-480c-9298-ef68239af134 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:39.596156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb3f9-5967-480c-9298-ef68239af134 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:39.596429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb3f9-5967-480c-9298-ef68239af134 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:39.597688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fb3f9-5967-480c-9298-ef68239af134 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:39.599202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fb3f9-5967-480c-9298-ef68239af134 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:39.601015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 201/393] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:39 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:39.606997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024f3c-acbb-47be-b92a-2cadec5305e0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:39.759005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c12f0-d020-41b9-8d6c-77c25658fbeb None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:39.759446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c12f0-d020-41b9-8d6c-77c25658fbeb None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:39.759682 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c12f0-d020-41b9-8d6c-77c25658fbeb None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:39.761306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 202/394] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:39.768041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762f02a-f3c3-491b-a917-9480a0c74ea1 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:39.768349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762f02a-f3c3-491b-a917-9480a0c74ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:39.768606 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762f02a-f3c3-491b-a917-9480a0c74ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:39.800429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-5762f02a-f3c3-491b-a917-9480a0c74ea1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:39.801626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-5762f02a-f3c3-491b-a917-9480a0c74ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:39.813134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024f3c-acbb-47be-b92a-2cadec5305e0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:39.848553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7970ba-a253-4acd-9cd0-5fcfb9a2deac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:39.849448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7970ba-a253-4acd-9cd0-5fcfb9a2deac None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:39.849730 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7970ba-a253-4acd-9cd0-5fcfb9a2deac None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:39.850006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7970ba-a253-4acd-9cd0-5fcfb9a2deac None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb/groups/5e51afed6cda444baa050d64eea4e5cc/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:39.852017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7970ba-a253-4acd-9cd0-5fcfb9a2deac None admin] RBAC: Authorizing `identity:create_grant(project_id=17128730ad3c43e194e508cc0fcd24cb, group_id=5e51afed6cda444baa050d64eea4e5cc, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:39.853485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7970ba-a253-4acd-9cd0-5fcfb9a2deac None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:39.877046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 203/395] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:39.899018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762f02a-f3c3-491b-a917-9480a0c74ea1 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:39.939340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 193/396] 10.222.0.64 () {58 vars in 1442 bytes} [Fri May 13 17:07:39 2022] PUT /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb/groups/5e51afed6cda444baa050d64eea4e5cc/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:40.003397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762f02a-f3c3-491b-a917-9480a0c74ea1 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:40.047502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b801d-12aa-45c7-bed9-ad83a2923913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:40.047502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b801d-12aa-45c7-bed9-ad83a2923913 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:40.047502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b801d-12aa-45c7-bed9-ad83a2923913 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:40.047502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b801d-12aa-45c7-bed9-ad83a2923913 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:40.053288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b801d-12aa-45c7-bed9-ad83a2923913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-e86b801d-12aa-45c7-bed9-ad83a2923913 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:40.061267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:40.062341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:40.063382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:40.065936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 204/397] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:40.071977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7970ba-a253-4acd-9cd0-5fcfb9a2deac None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:40.181796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7970ba-a253-4acd-9cd0-5fcfb9a2deac None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:40.217891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7eb91-5ccd-4659-bb17-a9bafebb6f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:40.218927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7eb91-5ccd-4659-bb17-a9bafebb6f74 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:40.219407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7eb91-5ccd-4659-bb17-a9bafebb6f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:40.219854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7eb91-5ccd-4659-bb17-a9bafebb6f74 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:40.220840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7eb91-5ccd-4659-bb17-a9bafebb6f74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:40.221843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7eb91-5ccd-4659-bb17-a9bafebb6f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:40.223537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7eb91-5ccd-4659-bb17-a9bafebb6f74 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:40.233214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 194/398] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:40.239374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b801d-12aa-45c7-bed9-ad83a2923913 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:40.342973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b801d-12aa-45c7-bed9-ad83a2923913 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:40.396048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124016d-c2cf-4a33-939c-39010f2a99f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:40.397213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124016d-c2cf-4a33-939c-39010f2a99f8 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:40.397696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124016d-c2cf-4a33-939c-39010f2a99f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:40.398153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124016d-c2cf-4a33-939c-39010f2a99f8 None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:40.399552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124016d-c2cf-4a33-939c-39010f2a99f8 None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:40.401190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124016d-c2cf-4a33-939c-39010f2a99f8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:40.403005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 205/399] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:40 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:40.409256 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7eb91-5ccd-4659-bb17-a9bafebb6f74 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:40.554438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7eb91-5ccd-4659-bb17-a9bafebb6f74 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:40.594776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d42ba5-1447-4e42-ab45-a759317ac507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:40.595609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d42ba5-1447-4e42-ab45-a759317ac507 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:40.596429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d42ba5-1447-4e42-ab45-a759317ac507 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:40.596720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d42ba5-1447-4e42-ab45-a759317ac507 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:40.598040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d42ba5-1447-4e42-ab45-a759317ac507 None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:40.599549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d42ba5-1447-4e42-ab45-a759317ac507 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:40.601332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 195/400] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:40 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:40.607184 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124016d-c2cf-4a33-939c-39010f2a99f8 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:40.751983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124016d-c2cf-4a33-939c-39010f2a99f8 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:40.794468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df67b1-8ed6-4025-8b5d-894f6cd60cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:40.795408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df67b1-8ed6-4025-8b5d-894f6cd60cdc None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:40.795690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df67b1-8ed6-4025-8b5d-894f6cd60cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:40.795964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df67b1-8ed6-4025-8b5d-894f6cd60cdc None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/groups/5e51afed6cda444baa050d64eea4e5cc/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:40.798121 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df67b1-8ed6-4025-8b5d-894f6cd60cdc None admin] RBAC: Authorizing `identity:create_grant(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4, group_id=5e51afed6cda444baa050d64eea4e5cc, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:40.800218 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df67b1-8ed6-4025-8b5d-894f6cd60cdc None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:40.893004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 206/401] 10.222.0.64 () {58 vars in 1442 bytes} [Fri May 13 17:07:40 2022] PUT /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/groups/5e51afed6cda444baa050d64eea4e5cc/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:41.099451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0db496-81d6-4672-801c-93fc1b6a3a99 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:41.099964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0db496-81d6-4672-801c-93fc1b6a3a99 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:41.100034 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0db496-81d6-4672-801c-93fc1b6a3a99 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:41.102032 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 196/402] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:41.107424 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d131c-ad0a-48ca-8fd1-14950fa25e65 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:41.107720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d131c-ad0a-48ca-8fd1-14950fa25e65 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:41.108001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d131c-ad0a-48ca-8fd1-14950fa25e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:41.130337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-1d1d131c-ad0a-48ca-8fd1-14950fa25e65 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:41.131689 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-1d1d131c-ad0a-48ca-8fd1-14950fa25e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:41.158742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e622f-e39c-47ff-9704-330d416a13e8 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:41.159016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e622f-e39c-47ff-9704-330d416a13e8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:41.159266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e622f-e39c-47ff-9704-330d416a13e8 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:41.160895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 197/403] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:41.166834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36042053-441f-414c-9fc4-7d6ea1acabfb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:41.167155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36042053-441f-414c-9fc4-7d6ea1acabfb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:41.167439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36042053-441f-414c-9fc4-7d6ea1acabfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:41.196148 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-36042053-441f-414c-9fc4-7d6ea1acabfb None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:41.197348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-36042053-441f-414c-9fc4-7d6ea1acabfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:41.206569 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 207/404] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:41.261135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d131c-ad0a-48ca-8fd1-14950fa25e65 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:41.300398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 198/405] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:41.378437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d131c-ad0a-48ca-8fd1-14950fa25e65 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:41.399879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36042053-441f-414c-9fc4-7d6ea1acabfb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:41.416704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a39b7-ee44-486d-841c-ec215c7d319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:41.417765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a39b7-ee44-486d-841c-ec215c7d319b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:41.418207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a39b7-ee44-486d-841c-ec215c7d319b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:41.418640 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a39b7-ee44-486d-841c-ec215c7d319b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:41.429107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a39b7-ee44-486d-841c-ec215c7d319b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-352a39b7-ee44-486d-841c-ec215c7d319b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:41.437641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:41.438723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:41.440272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:41.442504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 208/406] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:41.452080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a39b7-ee44-486d-841c-ec215c7d319b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:41.583824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36042053-441f-414c-9fc4-7d6ea1acabfb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:41.611963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a39b7-ee44-486d-841c-ec215c7d319b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:41.656336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9ddd2-7048-4238-b720-f5de2969f208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:41.657384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ddd2-7048-4238-b720-f5de2969f208 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:41.657814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ddd2-7048-4238-b720-f5de2969f208 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:41.658272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ddd2-7048-4238-b720-f5de2969f208 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:41.670971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9ddd2-7048-4238-b720-f5de2969f208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-39e9ddd2-7048-4238-b720-f5de2969f208 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:41.679694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:41.680762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:41.681775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:41.684026 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 199/407] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:07:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:41.689604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9ddd2-7048-4238-b720-f5de2969f208 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:41.691010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634bdd-0d92-4260-bf7d-5b896ca7e1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:41.692289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634bdd-0d92-4260-bf7d-5b896ca7e1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:41.694631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634bdd-0d92-4260-bf7d-5b896ca7e1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:41.695063 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634bdd-0d92-4260-bf7d-5b896ca7e1d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:41.696010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd634bdd-0d92-4260-bf7d-5b896ca7e1d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:41.697102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd634bdd-0d92-4260-bf7d-5b896ca7e1d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:41.706168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd634bdd-0d92-4260-bf7d-5b896ca7e1d7 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:41.716935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 209/408] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:41.722857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634bdd-0d92-4260-bf7d-5b896ca7e1d7 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:41.874153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634bdd-0d92-4260-bf7d-5b896ca7e1d7 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:41.901103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9ddd2-7048-4238-b720-f5de2969f208 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:41.920263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff2c24-51eb-4ef1-8714-54bf500e3332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:41.922146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2c24-51eb-4ef1-8714-54bf500e3332 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:41.922615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2c24-51eb-4ef1-8714-54bf500e3332 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:41.923277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2c24-51eb-4ef1-8714-54bf500e3332 None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:41.925551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff2c24-51eb-4ef1-8714-54bf500e3332 None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:41.927216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff2c24-51eb-4ef1-8714-54bf500e3332 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:41.930171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 210/409] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:41 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:41.935951 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff2c24-51eb-4ef1-8714-54bf500e3332 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:41.967830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324e678-3526-42ee-b107-6b7333ba983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:41.968514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324e678-3526-42ee-b107-6b7333ba983a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:41.968796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324e678-3526-42ee-b107-6b7333ba983a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:41.969066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324e678-3526-42ee-b107-6b7333ba983a None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:41.969812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324e678-3526-42ee-b107-6b7333ba983a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:41.970113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324e678-3526-42ee-b107-6b7333ba983a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:41.972186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324e678-3526-42ee-b107-6b7333ba983a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:41.994794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 200/410] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:42.000187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324e678-3526-42ee-b107-6b7333ba983a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:42.120372 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324e678-3526-42ee-b107-6b7333ba983a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:42.129270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff2c24-51eb-4ef1-8714-54bf500e3332 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:42.154996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0b7a4-16f5-4b0f-8fb3-10b09ff242ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:42.156248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b7a4-16f5-4b0f-8fb3-10b09ff242ac None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:42.156767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b7a4-16f5-4b0f-8fb3-10b09ff242ac None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:42.157244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b7a4-16f5-4b0f-8fb3-10b09ff242ac None admin] PATH_INFO: `/v3/groups/478bfb4cf5f4444a9f4a2ee5f4ba2134` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:42.159334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0b7a4-16f5-4b0f-8fb3-10b09ff242ac None admin] RBAC: Authorizing `identity:get_group(group_id=478bfb4cf5f4444a9f4a2ee5f4ba2134)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:42.160994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0b7a4-16f5-4b0f-8fb3-10b09ff242ac None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:42.163154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 201/411] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:41 2022] GET /identity/v3/groups/478bfb4cf5f4444a9f4a2ee5f4ba2134 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:42.169245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0b7a4-16f5-4b0f-8fb3-10b09ff242ac None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:42.197703 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadc230-8794-4cc5-83f0-536c0796a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:42.199561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc230-8794-4cc5-83f0-536c0796a69f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:42.200055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc230-8794-4cc5-83f0-536c0796a69f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:42.200537 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc230-8794-4cc5-83f0-536c0796a69f None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:42.202058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadc230-8794-4cc5-83f0-536c0796a69f None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:42.203987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadc230-8794-4cc5-83f0-536c0796a69f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:42.206311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 211/412] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:41 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:42.212162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadc230-8794-4cc5-83f0-536c0796a69f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:42.330087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadc230-8794-4cc5-83f0-536c0796a69f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:42.366738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e082ac-8a76-49a4-9723-ff7a1da90b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:42.368020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e082ac-8a76-49a4-9723-ff7a1da90b34 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:42.368698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e082ac-8a76-49a4-9723-ff7a1da90b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:42.369178 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e082ac-8a76-49a4-9723-ff7a1da90b34 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/groups/5e51afed6cda444baa050d64eea4e5cc/roles/1efabb1110d64eebacd85d9016d7d286` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:42.371711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e082ac-8a76-49a4-9723-ff7a1da90b34 None admin] RBAC: Authorizing `identity:create_grant(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4, group_id=5e51afed6cda444baa050d64eea4e5cc, role_id=1efabb1110d64eebacd85d9016d7d286)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:42.373845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e082ac-8a76-49a4-9723-ff7a1da90b34 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:42.420955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0b7a4-16f5-4b0f-8fb3-10b09ff242ac None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:42.458211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048e782-5069-485f-a2c1-08d2beec2a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:42.459534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e782-5069-485f-a2c1-08d2beec2a3f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:42.463182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e782-5069-485f-a2c1-08d2beec2a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:42.463540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e782-5069-485f-a2c1-08d2beec2a3f None admin] PATH_INFO: `/v3/projects/6e1067556b2a41588af4e1e6fd0de9f1` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:42.464913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048e782-5069-485f-a2c1-08d2beec2a3f None admin] RBAC: Authorizing `identity:get_project(project_id=6e1067556b2a41588af4e1e6fd0de9f1)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:42.466317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048e782-5069-485f-a2c1-08d2beec2a3f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:42.468355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 202/414] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:42 2022] GET /identity/v3/projects/6e1067556b2a41588af4e1e6fd0de9f1 => generated 344 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:42.468576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 212/414] 10.222.0.64 () {58 vars in 1442 bytes} [Fri May 13 17:07:42 2022] PUT /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4/groups/5e51afed6cda444baa050d64eea4e5cc/roles/1efabb1110d64eebacd85d9016d7d286 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:42.473457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469d7a2-2b22-4551-88a7-96495cc5eea9 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:42.473457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469d7a2-2b22-4551-88a7-96495cc5eea9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:42.473457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469d7a2-2b22-4551-88a7-96495cc5eea9 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:42.473457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 203/415] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:42.474982 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e082ac-8a76-49a4-9723-ff7a1da90b34 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:42.476960 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681275a-76ff-4e3b-8c7d-f53e6023f86b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:42.477248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681275a-76ff-4e3b-8c7d-f53e6023f86b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:42.477523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681275a-76ff-4e3b-8c7d-f53e6023f86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:42.504376 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f681275a-76ff-4e3b-8c7d-f53e6023f86b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:42.505598 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f681275a-76ff-4e3b-8c7d-f53e6023f86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:42.617259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e082ac-8a76-49a4-9723-ff7a1da90b34 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:42.653766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 204/416] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:42.660166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948f7f5-66f5-46e8-9409-001ef9254eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:42.661151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f7f5-66f5-46e8-9409-001ef9254eac None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:42.661441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f7f5-66f5-46e8-9409-001ef9254eac None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:42.661717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f7f5-66f5-46e8-9409-001ef9254eac None admin] PATH_INFO: `/v3/projects/6e1067556b2a41588af4e1e6fd0de9f1/groups/478bfb4cf5f4444a9f4a2ee5f4ba2134/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:42.668391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948f7f5-66f5-46e8-9409-001ef9254eac None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1067556b2a41588af4e1e6fd0de9f1, group_id=478bfb4cf5f4444a9f4a2ee5f4ba2134, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:42.669942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948f7f5-66f5-46e8-9409-001ef9254eac None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:42.691918 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681275a-76ff-4e3b-8c7d-f53e6023f86b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:42.765873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 213/417] 10.222.0.64 () {58 vars in 1442 bytes} [Fri May 13 17:07:42 2022] PUT /identity/v3/projects/6e1067556b2a41588af4e1e6fd0de9f1/groups/478bfb4cf5f4444a9f4a2ee5f4ba2134/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:07:42.830971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681275a-76ff-4e3b-8c7d-f53e6023f86b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:42.872337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c6859-56fa-4568-a915-f285d0d0c2d9 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:42.872648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c6859-56fa-4568-a915-f285d0d0c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:42.872900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c6859-56fa-4568-a915-f285d0d0c2d9 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:42.874524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 214/418] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:42.878167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a2ee8-8bd9-48a1-ad1a-b6704bb1bfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:42.879064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a2ee8-8bd9-48a1-ad1a-b6704bb1bfff None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:42.879401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a2ee8-8bd9-48a1-ad1a-b6704bb1bfff None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:42.879670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a2ee8-8bd9-48a1-ad1a-b6704bb1bfff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:42.885827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d6af-c989-4765-88c6-fe811b565f7f None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:42.886116 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d6af-c989-4765-88c6-fe811b565f7f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:42.886380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d6af-c989-4765-88c6-fe811b565f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:42.903856 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a2ee8-8bd9-48a1-ad1a-b6704bb1bfff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-531a2ee8-8bd9-48a1-ad1a-b6704bb1bfff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:42.912725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:42.913696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:42.914480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:42.917122 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 205/419] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:42.918712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-8ed2d6af-c989-4765-88c6-fe811b565f7f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:42.920260 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8ed2d6af-c989-4765-88c6-fe811b565f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:42.923898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a2ee8-8bd9-48a1-ad1a-b6704bb1bfff None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:43.027969 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 215/420] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:43.053242 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2d6af-c989-4765-88c6-fe811b565f7f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:43.069163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a2ee8-8bd9-48a1-ad1a-b6704bb1bfff None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:43.111225 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851de9-b93f-43e1-a3e1-c4e813390275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:43.112597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851de9-b93f-43e1-a3e1-c4e813390275 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:43.112944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851de9-b93f-43e1-a3e1-c4e813390275 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:43.113255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851de9-b93f-43e1-a3e1-c4e813390275 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:43.114025 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851de9-b93f-43e1-a3e1-c4e813390275 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:43.114515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851de9-b93f-43e1-a3e1-c4e813390275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:43.116271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851de9-b93f-43e1-a3e1-c4e813390275 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:43.125815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 206/421] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:43.131855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851de9-b93f-43e1-a3e1-c4e813390275 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:43.232598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2d6af-c989-4765-88c6-fe811b565f7f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:43.251155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851de9-b93f-43e1-a3e1-c4e813390275 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:43.281595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9834e1-a75b-4b57-b3b8-35ee310432a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:43.282338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9834e1-a75b-4b57-b3b8-35ee310432a8 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:43.282725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9834e1-a75b-4b57-b3b8-35ee310432a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:43.283108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9834e1-a75b-4b57-b3b8-35ee310432a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:43.315998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d586eb-8731-4b55-aa33-f04a863c6ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:43.317223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d586eb-8731-4b55-aa33-f04a863c6ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:43.317725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d586eb-8731-4b55-aa33-f04a863c6ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:43.318265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d586eb-8731-4b55-aa33-f04a863c6ae5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:43.344286 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d586eb-8731-4b55-aa33-f04a863c6ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-d9d586eb-8731-4b55-aa33-f04a863c6ae5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:43.359170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:43.360141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:43.360923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:43.362155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9834e1-a75b-4b57-b3b8-35ee310432a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:43.362155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9834e1-a75b-4b57-b3b8-35ee310432a8 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:43.364578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 216/422] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:43.369951 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d586eb-8731-4b55-aa33-f04a863c6ae5 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:43.464008 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 207/423] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 17:07:43.472142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9834e1-a75b-4b57-b3b8-35ee310432a8 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:43.500000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d586eb-8731-4b55-aa33-f04a863c6ae5 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:43.543954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805f804-c7a7-4712-abfb-b043c0a6eabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:43.544976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805f804-c7a7-4712-abfb-b043c0a6eabd None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:43.545467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805f804-c7a7-4712-abfb-b043c0a6eabd None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:43.545948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805f804-c7a7-4712-abfb-b043c0a6eabd None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:43.546922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805f804-c7a7-4712-abfb-b043c0a6eabd None admin] RBAC: Adding query filter params (name=member) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:43.547461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805f804-c7a7-4712-abfb-b043c0a6eabd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:43.549089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805f804-c7a7-4712-abfb-b043c0a6eabd None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:43.561989 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 217/424] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:43.563626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71aa99d-5297-43bf-a037-1b7e88a8024d None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:43.564122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71aa99d-5297-43bf-a037-1b7e88a8024d None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:43.565165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71aa99d-5297-43bf-a037-1b7e88a8024d None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:43.566638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 218/425] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:43.567596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71aa99d-5297-43bf-a037-1b7e88a8024d None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:43.594325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9834e1-a75b-4b57-b3b8-35ee310432a8 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:43.635029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29eb3-dbf7-4241-acf6-cc44a53d222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:43.636302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29eb3-dbf7-4241-acf6-cc44a53d222f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:43.636590 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29eb3-dbf7-4241-acf6-cc44a53d222f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:43.637124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29eb3-dbf7-4241-acf6-cc44a53d222f None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:43.638450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29eb3-dbf7-4241-acf6-cc44a53d222f None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:43.640499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29eb3-dbf7-4241-acf6-cc44a53d222f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:43.643518 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 208/426] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:43 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:43.644946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4e6c-6923-45f1-bc74-6857075975d4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:43.645229 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4e6c-6923-45f1-bc74-6857075975d4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:43.645500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4e6c-6923-45f1-bc74-6857075975d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:43.665263 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b81a4e6c-6923-45f1-bc74-6857075975d4 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:43.666452 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b81a4e6c-6923-45f1-bc74-6857075975d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:43.692886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71aa99d-5297-43bf-a037-1b7e88a8024d None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:43.733325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6ac4f-c7db-4e4e-9e77-c61c889ec5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:43.734910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6ac4f-c7db-4e4e-9e77-c61c889ec5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:43.735452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6ac4f-c7db-4e4e-9e77-c61c889ec5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:43.736101 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6ac4f-c7db-4e4e-9e77-c61c889ec5c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:43.745538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 209/427] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:43.751322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a4e6c-6923-45f1-bc74-6857075975d4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:43.831976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6ac4f-c7db-4e4e-9e77-c61c889ec5c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:43.834586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6ac4f-c7db-4e4e-9e77-c61c889ec5c5 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:43.870282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a4e6c-6923-45f1-bc74-6857075975d4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:43.905244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5145b-93bc-4825-a9db-4567ca7b40dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:43.906272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5145b-93bc-4825-a9db-4567ca7b40dc None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:43.906629 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5145b-93bc-4825-a9db-4567ca7b40dc None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:43.906964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5145b-93bc-4825-a9db-4567ca7b40dc None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:43.908305 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5145b-93bc-4825-a9db-4567ca7b40dc None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:43.909839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5145b-93bc-4825-a9db-4567ca7b40dc None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:43.911817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 210/428] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:43 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:43.917097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5145b-93bc-4825-a9db-4567ca7b40dc None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:43.962841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 219/429] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:43.964310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6ac4f-c7db-4e4e-9e77-c61c889ec5c5 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:44.028899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5145b-93bc-4825-a9db-4567ca7b40dc None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:44.065500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a094c-500f-4a82-a686-75af8908d36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:44.066297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a094c-500f-4a82-a686-75af8908d36b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:44.066577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a094c-500f-4a82-a686-75af8908d36b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:44.066852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a094c-500f-4a82-a686-75af8908d36b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:44.077527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a094c-500f-4a82-a686-75af8908d36b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:44.079173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6ac4f-c7db-4e4e-9e77-c61c889ec5c5 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-7c8a094c-500f-4a82-a686-75af8908d36b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:44.085514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:44.086387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:44.087202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 211/430] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:44.087855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a094c-500f-4a82-a686-75af8908d36b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:44.120162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0dbe-271a-428d-b4ad-d624758151d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:44.121083 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0dbe-271a-428d-b4ad-d624758151d7 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:44.121507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0dbe-271a-428d-b4ad-d624758151d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:44.121932 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0dbe-271a-428d-b4ad-d624758151d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:44.122909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c0dbe-271a-428d-b4ad-d624758151d7 None admin] RBAC: Adding query filter params (group.id=5e51afed6cda444baa050d64eea4e5cc, role.id=1efabb1110d64eebacd85d9016d7d286, scope.project.id=17128730ad3c43e194e508cc0fcd24cb) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:44.123405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c0dbe-271a-428d-b4ad-d624758151d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:44.125160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c0dbe-271a-428d-b4ad-d624758151d7 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:44.131921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 220/431] 10.222.0.64 () {56 vars in 1376 bytes} [Fri May 13 17:07:43 2022] GET /identity/v3/role_assignments?group.id=5e51afed6cda444baa050d64eea4e5cc&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=1efabb1110d64eebacd85d9016d7d286 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:44.132985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0dbe-271a-428d-b4ad-d624758151d7 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:44.261213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a094c-500f-4a82-a686-75af8908d36b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:44.284829 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0dbe-271a-428d-b4ad-d624758151d7 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:44.324166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74dd59-cd97-41a4-9be4-ed9883d24b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:44.327155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74dd59-cd97-41a4-9be4-ed9883d24b3d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:44.327627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74dd59-cd97-41a4-9be4-ed9883d24b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:44.328220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74dd59-cd97-41a4-9be4-ed9883d24b3d None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:44.331061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74dd59-cd97-41a4-9be4-ed9883d24b3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:44.332304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74dd59-cd97-41a4-9be4-ed9883d24b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:44.333893 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74dd59-cd97-41a4-9be4-ed9883d24b3d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:44.346732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca174-6647-41cb-bfb7-1d8f4ce5c200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:44.348024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca174-6647-41cb-bfb7-1d8f4ce5c200 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:44.348457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca174-6647-41cb-bfb7-1d8f4ce5c200 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:44.348971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca174-6647-41cb-bfb7-1d8f4ce5c200 None admin] PATH_INFO: `/v3/projects/17128730ad3c43e194e508cc0fcd24cb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:44.353937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 221/432] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:07:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:44.355322 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74dd59-cd97-41a4-9be4-ed9883d24b3d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:44.355566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cca174-6647-41cb-bfb7-1d8f4ce5c200 None admin] RBAC: Authorizing `identity:get_project(project_id=17128730ad3c43e194e508cc0fcd24cb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:44.357421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cca174-6647-41cb-bfb7-1d8f4ce5c200 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:44.359802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 212/433] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:44 2022] GET /identity/v3/projects/17128730ad3c43e194e508cc0fcd24cb => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:44.365603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca174-6647-41cb-bfb7-1d8f4ce5c200 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:44.481902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74dd59-cd97-41a4-9be4-ed9883d24b3d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:44.492748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca174-6647-41cb-bfb7-1d8f4ce5c200 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:44.517195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c5202-e687-4eb3-92c6-11492f2f5205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:44.518736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5202-e687-4eb3-92c6-11492f2f5205 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:44.519280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5202-e687-4eb3-92c6-11492f2f5205 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:44.519762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5202-e687-4eb3-92c6-11492f2f5205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:44.540158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85c112-2dfb-4d7e-99cf-51004564a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:44.541027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85c112-2dfb-4d7e-99cf-51004564a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:44.541307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85c112-2dfb-4d7e-99cf-51004564a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:44.541578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85c112-2dfb-4d7e-99cf-51004564a3f9 None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:44.543492 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85c112-2dfb-4d7e-99cf-51004564a3f9 None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:44.544946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85c112-2dfb-4d7e-99cf-51004564a3f9 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:44.546965 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 213/434] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:44 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:44.552717 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85c112-2dfb-4d7e-99cf-51004564a3f9 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:44.603006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c5202-e687-4eb3-92c6-11492f2f5205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:44.604847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c5202-e687-4eb3-92c6-11492f2f5205 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:44.659048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85c112-2dfb-4d7e-99cf-51004564a3f9 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:44.692637 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da53504-16ed-4b6f-9b2b-937bd19d3659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:44.693321 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53504-16ed-4b6f-9b2b-937bd19d3659 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:44.693604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53504-16ed-4b6f-9b2b-937bd19d3659 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:44.693882 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53504-16ed-4b6f-9b2b-937bd19d3659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:44.694714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da53504-16ed-4b6f-9b2b-937bd19d3659 None admin] RBAC: Adding query filter params (group.id=5e51afed6cda444baa050d64eea4e5cc, role.id=52bafac2651a4075879b7d97a4f9111e, scope.project.id=17128730ad3c43e194e508cc0fcd24cb) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:44.695024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da53504-16ed-4b6f-9b2b-937bd19d3659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:44.696511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da53504-16ed-4b6f-9b2b-937bd19d3659 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:44.703069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 214/435] 10.222.0.64 () {56 vars in 1376 bytes} [Fri May 13 17:07:44 2022] GET /identity/v3/role_assignments?group.id=5e51afed6cda444baa050d64eea4e5cc&scope.project.id=17128730ad3c43e194e508cc0fcd24cb&role.id=52bafac2651a4075879b7d97a4f9111e => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:44.711163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 222/436] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 17:07:44.719435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da53504-16ed-4b6f-9b2b-937bd19d3659 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:44.844062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da53504-16ed-4b6f-9b2b-937bd19d3659 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:44.882380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb4fe7-84d4-49e1-9925-4ce4788e58c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:44.883294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb4fe7-84d4-49e1-9925-4ce4788e58c6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:44.883580 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb4fe7-84d4-49e1-9925-4ce4788e58c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:44.883862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb4fe7-84d4-49e1-9925-4ce4788e58c6 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:44.885093 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb4fe7-84d4-49e1-9925-4ce4788e58c6 None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:44.886576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb4fe7-84d4-49e1-9925-4ce4788e58c6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:44.888659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 215/437] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:44 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:44.894310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c5202-e687-4eb3-92c6-11492f2f5205 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:44.999211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c5202-e687-4eb3-92c6-11492f2f5205 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:45.002108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15626-b405-4415-9dd1-2796594bb81d None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.002399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15626-b405-4415-9dd1-2796594bb81d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.002676 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15626-b405-4415-9dd1-2796594bb81d None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.006105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 216/438] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:45.047251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485892a-a547-4376-ac7c-f468bd44fe00 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.047251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485892a-a547-4376-ac7c-f468bd44fe00 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.047251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485892a-a547-4376-ac7c-f468bd44fe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.047251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0485892a-a547-4376-ac7c-f468bd44fe00 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:45.047251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0485892a-a547-4376-ac7c-f468bd44fe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:45.047637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14789f3e-d232-4e69-a77e-b50bea0cdd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:45.047637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14789f3e-d232-4e69-a77e-b50bea0cdd7d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.047637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14789f3e-d232-4e69-a77e-b50bea0cdd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.047637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14789f3e-d232-4e69-a77e-b50bea0cdd7d None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.047907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14789f3e-d232-4e69-a77e-b50bea0cdd7d None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:45.047907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14789f3e-d232-4e69-a77e-b50bea0cdd7d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:45.047907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 223/439] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:44 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:45.052808 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14789f3e-d232-4e69-a77e-b50bea0cdd7d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:45.116857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 217/440] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:45.140510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485892a-a547-4376-ac7c-f468bd44fe00 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:45.196992 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14789f3e-d232-4e69-a77e-b50bea0cdd7d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:45.239852 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7edf-5378-423b-9fc1-c8c42b233c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:45.240767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7edf-5378-423b-9fc1-c8c42b233c64 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.241277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7edf-5378-423b-9fc1-c8c42b233c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.241384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7edf-5378-423b-9fc1-c8c42b233c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.242533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc7edf-5378-423b-9fc1-c8c42b233c64 None admin] RBAC: Adding query filter params (group.id=5e51afed6cda444baa050d64eea4e5cc, role.id=52bafac2651a4075879b7d97a4f9111e, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:45.242533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc7edf-5378-423b-9fc1-c8c42b233c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:45.244156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc7edf-5378-423b-9fc1-c8c42b233c64 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:45.250154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 224/441] 10.222.0.64 () {56 vars in 1376 bytes} [Fri May 13 17:07:45 2022] GET /identity/v3/role_assignments?group.id=5e51afed6cda444baa050d64eea4e5cc&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=52bafac2651a4075879b7d97a4f9111e => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:45.270671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485892a-a547-4376-ac7c-f468bd44fe00 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:45.307775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59445c0-fb74-41a2-94b1-a2b6c613c458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:45.308597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59445c0-fb74-41a2-94b1-a2b6c613c458 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.308875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59445c0-fb74-41a2-94b1-a2b6c613c458 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.309144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59445c0-fb74-41a2-94b1-a2b6c613c458 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.320644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59445c0-fb74-41a2-94b1-a2b6c613c458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:45.326855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a92a-64b3-4bc1-97c1-e323512bfcb4 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.327176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a92a-64b3-4bc1-97c1-e323512bfcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.327507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a92a-64b3-4bc1-97c1-e323512bfcb4 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.329143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 225/442] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-c59445c0-fb74-41a2-94b1-a2b6c613c458 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:45.329410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:45.330798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:45.331628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 218/443] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:45.337355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a92a-64b3-4bc1-97c1-e323512bfcb4 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:45.338204 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cd81e-f1ff-4ad4-88aa-c7f4e22ccbc9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.338493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cd81e-f1ff-4ad4-88aa-c7f4e22ccbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.338776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cd81e-f1ff-4ad4-88aa-c7f4e22ccbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.359041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ee7cd81e-f1ff-4ad4-88aa-c7f4e22ccbc9 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:45.360640 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ee7cd81e-f1ff-4ad4-88aa-c7f4e22ccbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:45.441158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 219/444] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:45.465429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cd81e-f1ff-4ad4-88aa-c7f4e22ccbc9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:45.469298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a92a-64b3-4bc1-97c1-e323512bfcb4 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:45.505181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcf470-4f9a-486b-8da8-0a08ff23963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:45.505856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcf470-4f9a-486b-8da8-0a08ff23963d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.506139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcf470-4f9a-486b-8da8-0a08ff23963d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.506423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcf470-4f9a-486b-8da8-0a08ff23963d None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.507201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcf470-4f9a-486b-8da8-0a08ff23963d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:45.507519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcf470-4f9a-486b-8da8-0a08ff23963d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:45.509065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcf470-4f9a-486b-8da8-0a08ff23963d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:45.520488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 226/445] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:45.525698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcf470-4f9a-486b-8da8-0a08ff23963d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:45.573057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cd81e-f1ff-4ad4-88aa-c7f4e22ccbc9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:45.609658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197efc0-99c1-42f4-8bf9-11333eafd0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:45.610465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197efc0-99c1-42f4-8bf9-11333eafd0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.614954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197efc0-99c1-42f4-8bf9-11333eafd0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.614954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197efc0-99c1-42f4-8bf9-11333eafd0d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.624370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197efc0-99c1-42f4-8bf9-11333eafd0d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-5197efc0-99c1-42f4-8bf9-11333eafd0d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:45.633642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:45.634521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:45.635426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 220/446] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:07:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:45.637390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcf470-4f9a-486b-8da8-0a08ff23963d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:45.640355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197efc0-99c1-42f4-8bf9-11333eafd0d9 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:45.676934 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878732d-4503-42bc-8af7-c8934f24b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:45.677600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878732d-4503-42bc-8af7-c8934f24b8de None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.677888 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878732d-4503-42bc-8af7-c8934f24b8de None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.678158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878732d-4503-42bc-8af7-c8934f24b8de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.737510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197efc0-99c1-42f4-8bf9-11333eafd0d9 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:45.742137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878732d-4503-42bc-8af7-c8934f24b8de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:45.743640 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878732d-4503-42bc-8af7-c8934f24b8de None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:45.768067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e12a3b-9af8-41e2-9351-a0a88fb5a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:45.768715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12a3b-9af8-41e2-9351-a0a88fb5a43a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.768991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12a3b-9af8-41e2-9351-a0a88fb5a43a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.769259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12a3b-9af8-41e2-9351-a0a88fb5a43a None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.769983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e12a3b-9af8-41e2-9351-a0a88fb5a43a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:45.770280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e12a3b-9af8-41e2-9351-a0a88fb5a43a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:45.771685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e12a3b-9af8-41e2-9351-a0a88fb5a43a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:45.779245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 221/447] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:45.785061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e12a3b-9af8-41e2-9351-a0a88fb5a43a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:45.835684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 227/448] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 17:07:45.840999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878732d-4503-42bc-8af7-c8934f24b8de None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:45.878053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e12a3b-9af8-41e2-9351-a0a88fb5a43a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:45.909458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058227-90dc-49a5-a196-588d23baacf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:45.910097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058227-90dc-49a5-a196-588d23baacf6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.910382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058227-90dc-49a5-a196-588d23baacf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.910656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058227-90dc-49a5-a196-588d23baacf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.931900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878732d-4503-42bc-8af7-c8934f24b8de None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:45.963222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daab565-977d-470c-a504-02196b688c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:45.964077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daab565-977d-470c-a504-02196b688c46 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:45.964468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daab565-977d-470c-a504-02196b688c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:45.964741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daab565-977d-470c-a504-02196b688c46 None admin] PATH_INFO: `/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:45.965902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daab565-977d-470c-a504-02196b688c46 None admin] RBAC: Authorizing `identity:get_project(project_id=19f5d5a48c944cdfa4cc32849eaa1cf4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:45.967381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daab565-977d-470c-a504-02196b688c46 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:45.969046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 228/449] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:45 2022] GET /identity/v3/projects/19f5d5a48c944cdfa4cc32849eaa1cf4 => generated 302 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:45.974692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c058227-90dc-49a5-a196-588d23baacf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:45.974832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daab565-977d-470c-a504-02196b688c46 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:45.976210 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c058227-90dc-49a5-a196-588d23baacf6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:46.068673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daab565-977d-470c-a504-02196b688c46 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:46.070207 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 222/450] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 17:07:46.075887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058227-90dc-49a5-a196-588d23baacf6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:46.102964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7db108-1f1e-417c-a37b-6ad08a749147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:46.103853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db108-1f1e-417c-a37b-6ad08a749147 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:46.104136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db108-1f1e-417c-a37b-6ad08a749147 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:46.104409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db108-1f1e-417c-a37b-6ad08a749147 None admin] PATH_INFO: `/v3/groups/5e51afed6cda444baa050d64eea4e5cc` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:46.105578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7db108-1f1e-417c-a37b-6ad08a749147 None admin] RBAC: Authorizing `identity:get_group(group_id=5e51afed6cda444baa050d64eea4e5cc)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:46.107047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7db108-1f1e-417c-a37b-6ad08a749147 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:46.108718 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 229/451] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:45 2022] GET /identity/v3/groups/5e51afed6cda444baa050d64eea4e5cc => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:46.114422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7db108-1f1e-417c-a37b-6ad08a749147 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:46.170742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058227-90dc-49a5-a196-588d23baacf6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:46.202687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6373a7-0cc5-4d16-a8f6-16dddbb14417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:46.203563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6373a7-0cc5-4d16-a8f6-16dddbb14417 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:46.203848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6373a7-0cc5-4d16-a8f6-16dddbb14417 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:46.204149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6373a7-0cc5-4d16-a8f6-16dddbb14417 None admin] PATH_INFO: `/v3/projects/6e1067556b2a41588af4e1e6fd0de9f1` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:46.205822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6373a7-0cc5-4d16-a8f6-16dddbb14417 None admin] RBAC: Authorizing `identity:get_project(project_id=6e1067556b2a41588af4e1e6fd0de9f1)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:46.206619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7db108-1f1e-417c-a37b-6ad08a749147 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:46.207316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6373a7-0cc5-4d16-a8f6-16dddbb14417 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:46.208994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 223/452] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:07:46 2022] GET /identity/v3/projects/6e1067556b2a41588af4e1e6fd0de9f1 => generated 344 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:46.214227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6373a7-0cc5-4d16-a8f6-16dddbb14417 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:46.239252 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25938c4f-734b-4a4c-bbec-45972bd63f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:46.239897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25938c4f-734b-4a4c-bbec-45972bd63f1d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:46.240187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25938c4f-734b-4a4c-bbec-45972bd63f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:46.240461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25938c4f-734b-4a4c-bbec-45972bd63f1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:46.241288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25938c4f-734b-4a4c-bbec-45972bd63f1d None admin] RBAC: Adding query filter params (group.id=5e51afed6cda444baa050d64eea4e5cc, role.id=1efabb1110d64eebacd85d9016d7d286, scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:46.241597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25938c4f-734b-4a4c-bbec-45972bd63f1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:46.243042 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25938c4f-734b-4a4c-bbec-45972bd63f1d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:46.248609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 230/453] 10.222.0.64 () {56 vars in 1376 bytes} [Fri May 13 17:07:46 2022] GET /identity/v3/role_assignments?group.id=5e51afed6cda444baa050d64eea4e5cc&scope.project.id=19f5d5a48c944cdfa4cc32849eaa1cf4&role.id=1efabb1110d64eebacd85d9016d7d286 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:46.312176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6373a7-0cc5-4d16-a8f6-16dddbb14417 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:46.347596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35284ac5-1baf-4ee3-abaa-0236e52e5851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:46.348602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35284ac5-1baf-4ee3-abaa-0236e52e5851 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:46.348886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35284ac5-1baf-4ee3-abaa-0236e52e5851 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:46.349157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35284ac5-1baf-4ee3-abaa-0236e52e5851 None admin] PATH_INFO: `/v3/groups/478bfb4cf5f4444a9f4a2ee5f4ba2134` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:46.350409 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35284ac5-1baf-4ee3-abaa-0236e52e5851 None admin] RBAC: Authorizing `identity:get_group(group_id=478bfb4cf5f4444a9f4a2ee5f4ba2134)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:46.351919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35284ac5-1baf-4ee3-abaa-0236e52e5851 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:46.353567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 224/454] 10.222.0.64 () {56 vars in 1180 bytes} [Fri May 13 17:07:46 2022] GET /identity/v3/groups/478bfb4cf5f4444a9f4a2ee5f4ba2134 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:46.359438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25938c4f-734b-4a4c-bbec-45972bd63f1d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:46.457447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25938c4f-734b-4a4c-bbec-45972bd63f1d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:46.489672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66e2f7-bee7-414b-89f3-439f1cf1b0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:46.490332 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66e2f7-bee7-414b-89f3-439f1cf1b0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:46.490619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66e2f7-bee7-414b-89f3-439f1cf1b0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:46.490897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66e2f7-bee7-414b-89f3-439f1cf1b0e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:46.491762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66e2f7-bee7-414b-89f3-439f1cf1b0e9 None admin] RBAC: Adding query filter params (group.id=478bfb4cf5f4444a9f4a2ee5f4ba2134, role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=6e1067556b2a41588af4e1e6fd0de9f1) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:46.492075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66e2f7-bee7-414b-89f3-439f1cf1b0e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:46.493552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66e2f7-bee7-414b-89f3-439f1cf1b0e9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:46.499282 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 231/455] 10.222.0.64 () {56 vars in 1376 bytes} [Fri May 13 17:07:46 2022] GET /identity/v3/role_assignments?group.id=478bfb4cf5f4444a9f4a2ee5f4ba2134&scope.project.id=6e1067556b2a41588af4e1e6fd0de9f1&role.id=2791519d9bad43318f086666b6e64a20 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:49.267271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ecf54-366d-4755-8e23-3a3ea9fd64cf None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:49.267790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ecf54-366d-4755-8e23-3a3ea9fd64cf None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:49.267790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ecf54-366d-4755-8e23-3a3ea9fd64cf None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:49.269436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 225/456] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:49.274475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb49c03-9110-4658-887c-a6fc8734ac03 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:49.275370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb49c03-9110-4658-887c-a6fc8734ac03 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:49.275868 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb49c03-9110-4658-887c-a6fc8734ac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:49.300284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-ebb49c03-9110-4658-887c-a6fc8734ac03 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:49.301802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ebb49c03-9110-4658-887c-a6fc8734ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:49.387644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 232/457] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:49.423166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ecf54-366d-4755-8e23-3a3ea9fd64cf None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:49.451303 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1e7b3-92f1-468f-962f-ece14cdccc52 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:49.451957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1e7b3-92f1-468f-962f-ece14cdccc52 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:49.452442 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1e7b3-92f1-468f-962f-ece14cdccc52 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:49.454406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 233/458] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:49.460452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eaced-4171-4448-9225-58deaf8d710d None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:49.461072 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eaced-4171-4448-9225-58deaf8d710d None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:49.461553 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eaced-4171-4448-9225-58deaf8d710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:49.488739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-229eaced-4171-4448-9225-58deaf8d710d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:49.489948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-229eaced-4171-4448-9225-58deaf8d710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:49.597719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ecf54-366d-4755-8e23-3a3ea9fd64cf None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:49.616387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 234/459] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:49.635534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf8433-382f-4917-bfe9-54ace01075bf None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:49.635825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf8433-382f-4917-bfe9-54ace01075bf None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:49.636126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf8433-382f-4917-bfe9-54ace01075bf None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:49.638184 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 235/460] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:07:49.644061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee63b0-093f-4da0-90bd-5148c05906b5 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:49.644357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee63b0-093f-4da0-90bd-5148c05906b5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:49.644756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee63b0-093f-4da0-90bd-5148c05906b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:49.647703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282473c5-8a6e-41d1-bc9d-d4b4486784ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:49.648498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282473c5-8a6e-41d1-bc9d-d4b4486784ed None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:49.648852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282473c5-8a6e-41d1-bc9d-d4b4486784ed None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:49.649138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282473c5-8a6e-41d1-bc9d-d4b4486784ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:49.660242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282473c5-8a6e-41d1-bc9d-d4b4486784ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:49.661723 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282473c5-8a6e-41d1-bc9d-d4b4486784ed None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:49.664277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-5bee63b0-093f-4da0-90bd-5148c05906b5 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:49.665447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-5bee63b0-093f-4da0-90bd-5148c05906b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-282473c5-8a6e-41d1-bc9d-d4b4486784ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:49.680721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:49.681610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:49.682560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:49.682560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:49.682560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:49.682560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:49.682560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 226/461] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:49.683308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282473c5-8a6e-41d1-bc9d-d4b4486784ed None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:49.733947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 236/462] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:49.734802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee63b0-093f-4da0-90bd-5148c05906b5 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:49.793828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282473c5-8a6e-41d1-bc9d-d4b4486784ed None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:49.831322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f9481-bf7f-4a84-8adf-c1e407cef2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:49.832131 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f9481-bf7f-4a84-8adf-c1e407cef2cd None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:49.832408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f9481-bf7f-4a84-8adf-c1e407cef2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:49.832675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f9481-bf7f-4a84-8adf-c1e407cef2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:49.838684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee63b0-093f-4da0-90bd-5148c05906b5 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:49.843406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f9481-bf7f-4a84-8adf-c1e407cef2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:49.844909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f9481-bf7f-4a84-8adf-c1e407cef2cd None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-5f4f9481-bf7f-4a84-8adf-c1e407cef2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:49.863732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:49.865742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:49.867899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:49.867899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:49.867899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:49.867899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:49.867899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 227/463] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:49.867899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f9481-bf7f-4a84-8adf-c1e407cef2cd None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:49.879530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b0d84-7740-4322-90ec-bdc9f29ae60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:49.880203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0d84-7740-4322-90ec-bdc9f29ae60f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:49.880545 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0d84-7740-4322-90ec-bdc9f29ae60f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:49.880829 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0d84-7740-4322-90ec-bdc9f29ae60f None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:49.881624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b0d84-7740-4322-90ec-bdc9f29ae60f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:49.881932 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b0d84-7740-4322-90ec-bdc9f29ae60f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:49.883413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b0d84-7740-4322-90ec-bdc9f29ae60f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:49.894938 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 237/464] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:49.895805 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b0d84-7740-4322-90ec-bdc9f29ae60f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:49.970087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f9481-bf7f-4a84-8adf-c1e407cef2cd None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:49.997369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b0d84-7740-4322-90ec-bdc9f29ae60f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:50.006636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354650c-f330-4956-b9f2-96488b0e92df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:50.007481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354650c-f330-4956-b9f2-96488b0e92df None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.007755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354650c-f330-4956-b9f2-96488b0e92df None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.008029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354650c-f330-4956-b9f2-96488b0e92df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.019171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354650c-f330-4956-b9f2-96488b0e92df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:50.020681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354650c-f330-4956-b9f2-96488b0e92df None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:50.031090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677860c-753c-442b-967d-bf491e78bd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:50.032210 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677860c-753c-442b-967d-bf491e78bd9e None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.032552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677860c-753c-442b-967d-bf491e78bd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.032837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677860c-753c-442b-967d-bf491e78bd9e None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.034086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677860c-753c-442b-967d-bf491e78bd9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:50.034540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677860c-753c-442b-967d-bf491e78bd9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:50.035949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677860c-753c-442b-967d-bf491e78bd9e None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-4354650c-f330-4956-b9f2-96488b0e92df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:50.042420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:50.043271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:50.044137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:50.044137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:50.044137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:50.044137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:50.044137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 228/465] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:50.044405 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354650c-f330-4956-b9f2-96488b0e92df None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:50.054276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 238/466] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:50.056321 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee8c6a-08e3-436f-b6de-28d983ea3a4f None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.057119 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee8c6a-08e3-436f-b6de-28d983ea3a4f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.057870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee8c6a-08e3-436f-b6de-28d983ea3a4f None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.059640 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 239/467] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:50.061197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee8c6a-08e3-436f-b6de-28d983ea3a4f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:50.144179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354650c-f330-4956-b9f2-96488b0e92df None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:50.166117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee8c6a-08e3-436f-b6de-28d983ea3a4f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:50.181882 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edcc3a-93a5-4fb8-ae2d-e78e26a9341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:50.182559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edcc3a-93a5-4fb8-ae2d-e78e26a9341b None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.182846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edcc3a-93a5-4fb8-ae2d-e78e26a9341b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.183101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edcc3a-93a5-4fb8-ae2d-e78e26a9341b None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.183830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edcc3a-93a5-4fb8-ae2d-e78e26a9341b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:50.185281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edcc3a-93a5-4fb8-ae2d-e78e26a9341b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:50.199850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b999822-3ad5-415e-84b1-702c87c65128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:50.200518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b999822-3ad5-415e-84b1-702c87c65128 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.200800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b999822-3ad5-415e-84b1-702c87c65128 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.201075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b999822-3ad5-415e-84b1-702c87c65128 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.201798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b999822-3ad5-415e-84b1-702c87c65128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:50.202263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b999822-3ad5-415e-84b1-702c87c65128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:50.203702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b999822-3ad5-415e-84b1-702c87c65128 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:50.214531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 240/468] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:50.215387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b999822-3ad5-415e-84b1-702c87c65128 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:50.261059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 229/469] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:07:50 2022] POST /identity/v3/users => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:07:50.262752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dc2e3-7afa-40e8-837d-5956a7d1ec02 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.263043 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dc2e3-7afa-40e8-837d-5956a7d1ec02 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.263343 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dc2e3-7afa-40e8-837d-5956a7d1ec02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.281240 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ec2dc2e3-7afa-40e8-837d-5956a7d1ec02 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:50.282664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ec2dc2e3-7afa-40e8-837d-5956a7d1ec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:50.336691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b999822-3ad5-415e-84b1-702c87c65128 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:50.376931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 230/470] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:50.378130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dc2e3-7afa-40e8-837d-5956a7d1ec02 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:50.399628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a2175-ee93-452e-bdab-b86529bc91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:50.400299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2175-ee93-452e-bdab-b86529bc91d5 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.400586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2175-ee93-452e-bdab-b86529bc91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.400858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2175-ee93-452e-bdab-b86529bc91d5 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.401589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a2175-ee93-452e-bdab-b86529bc91d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:50.403158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a2175-ee93-452e-bdab-b86529bc91d5 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:50.491414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dc2e3-7afa-40e8-837d-5956a7d1ec02 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:50.491699 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 241/471] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:07:50 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:07:50.492543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a2175-ee93-452e-bdab-b86529bc91d5 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:50.538084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922471-0ee3-475a-838b-d491b13fa005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:50.539830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922471-0ee3-475a-838b-d491b13fa005 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.540373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922471-0ee3-475a-838b-d491b13fa005 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.540839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922471-0ee3-475a-838b-d491b13fa005 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.541800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c922471-0ee3-475a-838b-d491b13fa005 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:50.544370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c922471-0ee3-475a-838b-d491b13fa005 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:50.612955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a2175-ee93-452e-bdab-b86529bc91d5 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:50.652713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 231/472] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:07:50 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:07:50.653993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a0ce9-c76c-4da8-9a9e-40e5050f5841 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.654287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a0ce9-c76c-4da8-9a9e-40e5050f5841 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.654569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a0ce9-c76c-4da8-9a9e-40e5050f5841 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.654926 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896efeab-732e-4fea-b7cb-34d3b228e2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:50.656148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896efeab-732e-4fea-b7cb-34d3b228e2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.656319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 232/473] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:50.656816 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896efeab-732e-4fea-b7cb-34d3b228e2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.657361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896efeab-732e-4fea-b7cb-34d3b228e2e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.662545 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc123d-2d63-4f43-9b9b-693668f476df None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.665198 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc123d-2d63-4f43-9b9b-693668f476df None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.665198 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc123d-2d63-4f43-9b9b-693668f476df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.673241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896efeab-732e-4fea-b7cb-34d3b228e2e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:50.675471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896efeab-732e-4fea-b7cb-34d3b228e2e1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:50.680912 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-89fc123d-2d63-4f43-9b9b-693668f476df None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:50.682365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-89fc123d-2d63-4f43-9b9b-693668f476df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-896efeab-732e-4fea-b7cb-34d3b228e2e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:50.698195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:50.699512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:50.700380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:50.700380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:50.700380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:50.700380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:50.700380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 242/474] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:50.707258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896efeab-732e-4fea-b7cb-34d3b228e2e1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:50.772143 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 233/475] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:50.810082 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc123d-2d63-4f43-9b9b-693668f476df None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:50.871307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896efeab-732e-4fea-b7cb-34d3b228e2e1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:50.930239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e3e1-a408-4f7e-b6be-88bc81ddfb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:50.930909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e3e1-a408-4f7e-b6be-88bc81ddfb34 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.931287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e3e1-a408-4f7e-b6be-88bc81ddfb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.931560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e3e1-a408-4f7e-b6be-88bc81ddfb34 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.932298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402e3e1-a408-4f7e-b6be-88bc81ddfb34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:50.932608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402e3e1-a408-4f7e-b6be-88bc81ddfb34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:50.934026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402e3e1-a408-4f7e-b6be-88bc81ddfb34 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:50.941977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc123d-2d63-4f43-9b9b-693668f476df None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:50.950715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 243/476] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:50.957884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e3e1-a408-4f7e-b6be-88bc81ddfb34 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:50.983213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9250bc-72af-4c3c-8982-99b6a911c941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:50.984894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9250bc-72af-4c3c-8982-99b6a911c941 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:50.985523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9250bc-72af-4c3c-8982-99b6a911c941 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:50.986124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9250bc-72af-4c3c-8982-99b6a911c941 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:50.987840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9250bc-72af-4c3c-8982-99b6a911c941 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:50.990248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9250bc-72af-4c3c-8982-99b6a911c941 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:51.046606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.sql.core [None req-2a9250bc-72af-4c3c-8982-99b6a911c941 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 17:07:51.046606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 13 17:07:51.046606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [parameters: {'id': '0203dd60490e4c6dbdb97dd0240337b1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 13 17:07:51.046606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80072) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 17:07:51.068474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e3e1-a408-4f7e-b6be-88bc81ddfb34 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-2a9250bc-72af-4c3c-8982-99b6a911c941 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application result = self._query(query) May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application conn.query(q) May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application result.read() May 13 17:07:51.078390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return ref.to_dict() May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 17:07:51.079592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application next(self.gen) May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application yield resource May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application next(self.gen) May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self.session.rollback() May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self.force_reraise() May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise self.value May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application session.commit() May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 17:07:51.080702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._prepare_impl() May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self.session.flush() May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._flush(objects) May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application compat.raise_( May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application flush_context.execute() May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rec.execute(self) May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 17:07:51.081783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application c = connection._execute_20( May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 17:07:51.082830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application result = self._query(query) May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application conn.query(q) May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application result.read() May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 17:07:51.084060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [parameters: {'id': '0203dd60490e4c6dbdb97dd0240337b1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:51.085041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 13 17:07:51.085995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:51.086955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 234/477] 10.222.0.64 () {60 vars in 1131 bytes} [Fri May 13 17:07:50 2022] POST /identity/v3/roles => generated 144 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:51.086955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9250bc-72af-4c3c-8982-99b6a911c941 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:51.152385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255667-8281-4eb2-b39f-f6566ce7ff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:51.153076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255667-8281-4eb2-b39f-f6566ce7ff98 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:51.153359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255667-8281-4eb2-b39f-f6566ce7ff98 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:51.153637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255667-8281-4eb2-b39f-f6566ce7ff98 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:51.154355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83255667-8281-4eb2-b39f-f6566ce7ff98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:51.163047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83255667-8281-4eb2-b39f-f6566ce7ff98 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:51.243638 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9250bc-72af-4c3c-8982-99b6a911c941 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:51.278094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 244/478] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:07:50 2022] POST /identity/v3/users => generated 249 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:07:51.293162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcf040-e525-4b45-b823-8dd4da0614ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:51.294796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf040-e525-4b45-b823-8dd4da0614ea None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:51.295322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf040-e525-4b45-b823-8dd4da0614ea None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:51.295790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf040-e525-4b45-b823-8dd4da0614ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:51.307457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcf040-e525-4b45-b823-8dd4da0614ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-a9fcf040-e525-4b45-b823-8dd4da0614ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:51.316825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:51.317784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 17:07:51.318570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:51.321366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 235/479] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:07:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:51.328611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255667-8281-4eb2-b39f-f6566ce7ff98 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:51.481480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255667-8281-4eb2-b39f-f6566ce7ff98 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:51.526527 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211037b5-1f7d-471e-8d53-8a3b5452d2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:51.527197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211037b5-1f7d-471e-8d53-8a3b5452d2fe None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:51.527486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211037b5-1f7d-471e-8d53-8a3b5452d2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:51.527763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211037b5-1f7d-471e-8d53-8a3b5452d2fe None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:51.528527 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211037b5-1f7d-471e-8d53-8a3b5452d2fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:51.528835 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211037b5-1f7d-471e-8d53-8a3b5452d2fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:51.530234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211037b5-1f7d-471e-8d53-8a3b5452d2fe None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:51.540785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 245/480] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:53.257273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998841f6-f4f9-43ad-baad-401c978dc6c5 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:53.257798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998841f6-f4f9-43ad-baad-401c978dc6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:53.257798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998841f6-f4f9-43ad-baad-401c978dc6c5 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:53.259414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 236/481] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:53.264751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad59996-b1c9-4842-bcfc-e467a92326a2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:53.265128 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad59996-b1c9-4842-bcfc-e467a92326a2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:53.265320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad59996-b1c9-4842-bcfc-e467a92326a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:53.287520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-3ad59996-b1c9-4842-bcfc-e467a92326a2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:53.288730 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3ad59996-b1c9-4842-bcfc-e467a92326a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:53.378578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0203a-1f1a-4670-be51-d6d6f2307d6e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:53.378893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0203a-1f1a-4670-be51-d6d6f2307d6e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:53.379151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0203a-1f1a-4670-be51-d6d6f2307d6e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:53.380862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 237/482] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:53.385694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 246/483] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:53.385937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98a78-8038-4b58-bd60-731ff48161aa None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:53.386232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98a78-8038-4b58-bd60-731ff48161aa None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:53.386513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98a78-8038-4b58-bd60-731ff48161aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:53.410799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3bc98a78-8038-4b58-bd60-731ff48161aa None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:53.412022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3bc98a78-8038-4b58-bd60-731ff48161aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:53.425795 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad59996-b1c9-4842-bcfc-e467a92326a2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:53.530726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 238/484] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:07:53.553552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98a78-8038-4b58-bd60-731ff48161aa None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:53.571591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad59996-b1c9-4842-bcfc-e467a92326a2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:53.605905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda0ea4-9607-4141-815e-722da1f526e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:53.606707 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda0ea4-9607-4141-815e-722da1f526e3 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:53.606992 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda0ea4-9607-4141-815e-722da1f526e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:53.607300 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda0ea4-9607-4141-815e-722da1f526e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:53.618297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda0ea4-9607-4141-815e-722da1f526e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-ceda0ea4-9607-4141-815e-722da1f526e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:53.626118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:53.628846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 247/485] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:53.630746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca127b-b470-4fd5-ae56-d693ac8d1b48 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:53.632448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca127b-b470-4fd5-ae56-d693ac8d1b48 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:53.632448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca127b-b470-4fd5-ae56-d693ac8d1b48 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:53.638631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 248/486] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:53.639347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca127b-b470-4fd5-ae56-d693ac8d1b48 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:53.659329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98a78-8038-4b58-bd60-731ff48161aa None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:53.703677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1a79e-bcd4-404c-8c4b-27c02eb29dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:53.704075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1a79e-bcd4-404c-8c4b-27c02eb29dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:53.704364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1a79e-bcd4-404c-8c4b-27c02eb29dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:53.704637 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1a79e-bcd4-404c-8c4b-27c02eb29dd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:53.719153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1a79e-bcd4-404c-8c4b-27c02eb29dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-a3f1a79e-bcd4-404c-8c4b-27c02eb29dd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:53.731152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:53.733249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 239/487] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:53.735209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a076-e0d9-42fa-b9fa-f21cf1676d46 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:53.737424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a076-e0d9-42fa-b9fa-f21cf1676d46 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:53.737424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a076-e0d9-42fa-b9fa-f21cf1676d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:53.750178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-39b8a076-e0d9-42fa-b9fa-f21cf1676d46 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:53.751579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-39b8a076-e0d9-42fa-b9fa-f21cf1676d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:53.778774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca127b-b470-4fd5-ae56-d693ac8d1b48 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:53.843226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 240/488] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:53.843226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8a076-e0d9-42fa-b9fa-f21cf1676d46 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:53.847155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f7aa-c797-4dbe-818e-2d53fca77ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:53.847155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f7aa-c797-4dbe-818e-2d53fca77ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:53.847533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f7aa-c797-4dbe-818e-2d53fca77ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:53.847533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f7aa-c797-4dbe-818e-2d53fca77ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:53.851151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65f7aa-c797-4dbe-818e-2d53fca77ab1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:53.851151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65f7aa-c797-4dbe-818e-2d53fca77ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:53.851151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65f7aa-c797-4dbe-818e-2d53fca77ab1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:53.866424 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 249/489] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:07:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:53.872627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f7aa-c797-4dbe-818e-2d53fca77ab1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:53.977521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8a076-e0d9-42fa-b9fa-f21cf1676d46 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:54.016597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16353c7-e8f5-4dd2-b096-f0234299fb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:54.017277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16353c7-e8f5-4dd2-b096-f0234299fb55 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.017614 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16353c7-e8f5-4dd2-b096-f0234299fb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.023220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16353c7-e8f5-4dd2-b096-f0234299fb55 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.023220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16353c7-e8f5-4dd2-b096-f0234299fb55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:54.023220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16353c7-e8f5-4dd2-b096-f0234299fb55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:54.023220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16353c7-e8f5-4dd2-b096-f0234299fb55 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:54.033188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 241/490] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:07:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:54.034148 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16353c7-e8f5-4dd2-b096-f0234299fb55 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:54.071173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f7aa-c797-4dbe-818e-2d53fca77ab1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:54.138205 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846bbf4-f28f-410e-af5c-f4b553fa3dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:54.139009 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846bbf4-f28f-410e-af5c-f4b553fa3dbc None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.139342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846bbf4-f28f-410e-af5c-f4b553fa3dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.139620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846bbf4-f28f-410e-af5c-f4b553fa3dbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.152569 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846bbf4-f28f-410e-af5c-f4b553fa3dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:54.154665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846bbf4-f28f-410e-af5c-f4b553fa3dbc None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:54.170004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16353c7-e8f5-4dd2-b096-f0234299fb55 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-3846bbf4-f28f-410e-af5c-f4b553fa3dbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:54.179661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:54.180632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:54.181444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:54.181444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:54.181444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:54.181444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:54.184963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 250/491] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:54.186603 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846bbf4-f28f-410e-af5c-f4b553fa3dbc None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:54.221938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a55dc-6a7c-4034-b7e8-d59add06ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:54.222912 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a55dc-6a7c-4034-b7e8-d59add06ba37 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.223314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a55dc-6a7c-4034-b7e8-d59add06ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.223653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a55dc-6a7c-4034-b7e8-d59add06ba37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.235551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a55dc-6a7c-4034-b7e8-d59add06ba37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-972a55dc-6a7c-4034-b7e8-d59add06ba37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:54.243865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:54.244764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:54.245549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 242/492] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:07:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:54.246685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be26dd-964a-4b39-8c87-0b2ed0f4f4ad None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.246685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be26dd-964a-4b39-8c87-0b2ed0f4f4ad None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.246848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be26dd-964a-4b39-8c87-0b2ed0f4f4ad None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.248217 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 243/493] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:54.253318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be26dd-964a-4b39-8c87-0b2ed0f4f4ad None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:54.301954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846bbf4-f28f-410e-af5c-f4b553fa3dbc None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:54.335633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788f426-64f8-43ac-aa4e-b18679e4e8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:54.336464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788f426-64f8-43ac-aa4e-b18679e4e8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.336772 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788f426-64f8-43ac-aa4e-b18679e4e8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.337051 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788f426-64f8-43ac-aa4e-b18679e4e8d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.347532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788f426-64f8-43ac-aa4e-b18679e4e8d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:54.353166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788f426-64f8-43ac-aa4e-b18679e4e8d1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:54.359446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be26dd-964a-4b39-8c87-0b2ed0f4f4ad None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-7788f426-64f8-43ac-aa4e-b18679e4e8d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:54.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:54.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:54.367924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:54.367924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:54.367924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:54.367924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:54.367924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 251/494] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:54.368195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788f426-64f8-43ac-aa4e-b18679e4e8d1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:54.392942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528d0e-1958-459d-8ca6-5d6583c871ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:54.393520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528d0e-1958-459d-8ca6-5d6583c871ae None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.393800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528d0e-1958-459d-8ca6-5d6583c871ae None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.394073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528d0e-1958-459d-8ca6-5d6583c871ae None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.394785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d528d0e-1958-459d-8ca6-5d6583c871ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:54.395089 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d528d0e-1958-459d-8ca6-5d6583c871ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:54.396525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d528d0e-1958-459d-8ca6-5d6583c871ae None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:54.413105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 244/495] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:54.417656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dbf70-3af4-4542-bea1-865de66a6fca None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.417656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dbf70-3af4-4542-bea1-865de66a6fca None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.417656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dbf70-3af4-4542-bea1-865de66a6fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.431261 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2d2dbf70-3af4-4542-bea1-865de66a6fca None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:54.432454 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2d2dbf70-3af4-4542-bea1-865de66a6fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:54.490791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788f426-64f8-43ac-aa4e-b18679e4e8d1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:54.522053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 245/496] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:54.522363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb282f42-c466-47b0-946a-add8ef38daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:54.523027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb282f42-c466-47b0-946a-add8ef38daaa None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.523344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb282f42-c466-47b0-946a-add8ef38daaa None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.523440 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2edb2-ba23-4a38-a2f5-86b90f6fd4fe None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.523622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb282f42-c466-47b0-946a-add8ef38daaa None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.523718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2edb2-ba23-4a38-a2f5-86b90f6fd4fe None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.523894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2edb2-ba23-4a38-a2f5-86b90f6fd4fe None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.524368 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb282f42-c466-47b0-946a-add8ef38daaa None admin] RBAC: Adding query filter params (name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:54.524677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb282f42-c466-47b0-946a-add8ef38daaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:54.525309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 246/497] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:54.525816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2edb2-ba23-4a38-a2f5-86b90f6fd4fe None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:54.526147 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb282f42-c466-47b0-946a-add8ef38daaa None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:54.536550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 252/498] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:07:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:54.537091 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb282f42-c466-47b0-946a-add8ef38daaa None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:54.626180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2edb2-ba23-4a38-a2f5-86b90f6fd4fe None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:54.632855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb282f42-c466-47b0-946a-add8ef38daaa None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:54.663782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37688b1-6eca-4cd0-ad0e-53cc1e748a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:54.664375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37688b1-6eca-4cd0-ad0e-53cc1e748a13 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.664661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37688b1-6eca-4cd0-ad0e-53cc1e748a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.664929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37688b1-6eca-4cd0-ad0e-53cc1e748a13 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.665641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37688b1-6eca-4cd0-ad0e-53cc1e748a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:54.665963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37688b1-6eca-4cd0-ad0e-53cc1e748a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:54.667377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37688b1-6eca-4cd0-ad0e-53cc1e748a13 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:54.677799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4a667-f80c-4ccf-b2b1-ac2b834e5a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:54.678593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4a667-f80c-4ccf-b2b1-ac2b834e5a5c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.678878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4a667-f80c-4ccf-b2b1-ac2b834e5a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.679013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 247/499] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:54.683651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4a667-f80c-4ccf-b2b1-ac2b834e5a5c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.683746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbbe1c-e322-444c-a28a-0b47f6855996 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.683746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbbe1c-e322-444c-a28a-0b47f6855996 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.683746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbbe1c-e322-444c-a28a-0b47f6855996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.692163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4a667-f80c-4ccf-b2b1-ac2b834e5a5c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:54.693642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4a667-f80c-4ccf-b2b1-ac2b834e5a5c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:54.696739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8edbbe1c-e322-444c-a28a-0b47f6855996 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:54.697931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8edbbe1c-e322-444c-a28a-0b47f6855996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-c0a4a667-f80c-4ccf-b2b1-ac2b834e5a5c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:07:54.709113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:54.710180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 253/500] 10.222.0.64 () {56 vars in 1093 bytes} [Fri May 13 17:07:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:54.711267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4a667-f80c-4ccf-b2b1-ac2b834e5a5c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:54.764423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 248/501] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:54.765254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbbe1c-e322-444c-a28a-0b47f6855996 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:54.805868 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4a667-f80c-4ccf-b2b1-ac2b834e5a5c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:54.838113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed727d4-37fa-4446-aa67-9ae5e68d9b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:54.838918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed727d4-37fa-4446-aa67-9ae5e68d9b78 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.839235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed727d4-37fa-4446-aa67-9ae5e68d9b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.839515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed727d4-37fa-4446-aa67-9ae5e68d9b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.849531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed727d4-37fa-4446-aa67-9ae5e68d9b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:54.851000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed727d4-37fa-4446-aa67-9ae5e68d9b78 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:54.858296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbbe1c-e322-444c-a28a-0b47f6855996 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-0ed727d4-37fa-4446-aa67-9ae5e68d9b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:54.867688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:54.868578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:54.869419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:54.869419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:54.869419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:54.869419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:54.871271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 254/502] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:54.872341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed727d4-37fa-4446-aa67-9ae5e68d9b78 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:54.891766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d984ee-ce65-4b13-b213-e4054079910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:54.893142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d984ee-ce65-4b13-b213-e4054079910c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:54.893399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d984ee-ce65-4b13-b213-e4054079910c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:54.893670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d984ee-ce65-4b13-b213-e4054079910c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:54.903309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d984ee-ce65-4b13-b213-e4054079910c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-54d984ee-ce65-4b13-b213-e4054079910c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:54.910977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:54.911893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:54.912687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 249/503] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:07:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:54.913336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d984ee-ce65-4b13-b213-e4054079910c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:54.970356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed727d4-37fa-4446-aa67-9ae5e68d9b78 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.002703 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040910e-9bf7-4fce-9440-a9511353de0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.011038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040910e-9bf7-4fce-9440-a9511353de0f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.011038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040910e-9bf7-4fce-9440-a9511353de0f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.011038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040910e-9bf7-4fce-9440-a9511353de0f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.012137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d984ee-ce65-4b13-b213-e4054079910c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.012505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040910e-9bf7-4fce-9440-a9511353de0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.014004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040910e-9bf7-4fce-9440-a9511353de0f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-1040910e-9bf7-4fce-9440-a9511353de0f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:07:55.029139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:55.030258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:55.031156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:55.031156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:55.031156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:07:55.031156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:07:55.031156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:07:55.031156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:07:55.031156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:07:55.031156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:07:55.031156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 17:07:55.031156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:55.035000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 255/504] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:55.035742 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040910e-9bf7-4fce-9440-a9511353de0f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:55.051062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62f520-f175-4064-a840-50268ab7391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.051773 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f520-f175-4064-a840-50268ab7391b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.052056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f520-f175-4064-a840-50268ab7391b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.052335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f520-f175-4064-a840-50268ab7391b None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.053173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62f520-f175-4064-a840-50268ab7391b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:55.053484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62f520-f175-4064-a840-50268ab7391b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.055079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62f520-f175-4064-a840-50268ab7391b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:55.094118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 250/505] 10.222.0.64 () {56 vars in 1133 bytes} [Fri May 13 17:07:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:55.094956 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62f520-f175-4064-a840-50268ab7391b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:55.134740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040910e-9bf7-4fce-9440-a9511353de0f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.165542 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337f075-ab76-4112-9639-b01e128813ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.166328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337f075-ab76-4112-9639-b01e128813ad None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.166610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337f075-ab76-4112-9639-b01e128813ad None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.166886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337f075-ab76-4112-9639-b01e128813ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.177363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337f075-ab76-4112-9639-b01e128813ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.178818 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337f075-ab76-4112-9639-b01e128813ad None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:55.187386 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62f520-f175-4064-a840-50268ab7391b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-2337f075-ab76-4112-9639-b01e128813ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:55.195648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:55.196543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:55.197549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:55.197549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:55.197549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:55.197549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:55.197549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 256/506] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:55.197549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337f075-ab76-4112-9639-b01e128813ad None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:55.221691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29909028-f95a-475b-983c-96dc5a053e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.222282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29909028-f95a-475b-983c-96dc5a053e8c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.222562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29909028-f95a-475b-983c-96dc5a053e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.222839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29909028-f95a-475b-983c-96dc5a053e8c None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.223621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29909028-f95a-475b-983c-96dc5a053e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:55.223928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29909028-f95a-475b-983c-96dc5a053e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.225342 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29909028-f95a-475b-983c-96dc5a053e8c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:55.236773 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 251/507] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:55.237570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29909028-f95a-475b-983c-96dc5a053e8c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:55.296308 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337f075-ab76-4112-9639-b01e128813ad None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.328319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b563-118c-4303-a8da-dabd671fa75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.328975 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b563-118c-4303-a8da-dabd671fa75c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.329258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b563-118c-4303-a8da-dabd671fa75c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.329532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b563-118c-4303-a8da-dabd671fa75c None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.330385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4b563-118c-4303-a8da-dabd671fa75c None admin] RBAC: Adding query filter params (name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:55.330690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4b563-118c-4303-a8da-dabd671fa75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.332111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4b563-118c-4303-a8da-dabd671fa75c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:55.334459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29909028-f95a-475b-983c-96dc5a053e8c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.339788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 257/508] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:07:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:55.340576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b563-118c-4303-a8da-dabd671fa75c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:55.370941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a92fa0-a2db-44c3-b396-c322cb421058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.375062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a92fa0-a2db-44c3-b396-c322cb421058 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.375384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a92fa0-a2db-44c3-b396-c322cb421058 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.375672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a92fa0-a2db-44c3-b396-c322cb421058 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.376528 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a92fa0-a2db-44c3-b396-c322cb421058 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:55.377409 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a92fa0-a2db-44c3-b396-c322cb421058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.378896 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a92fa0-a2db-44c3-b396-c322cb421058 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:55.395916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 252/509] 10.222.0.64 () {56 vars in 1137 bytes} [Fri May 13 17:07:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:55.396813 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a92fa0-a2db-44c3-b396-c322cb421058 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:55.462620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b563-118c-4303-a8da-dabd671fa75c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.490277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a92fa0-a2db-44c3-b396-c322cb421058 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.496068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a17614-7fe9-4f9f-9a4c-e1d3b1c7b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.497800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a17614-7fe9-4f9f-9a4c-e1d3b1c7b9ad None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.498085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a17614-7fe9-4f9f-9a4c-e1d3b1c7b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.498362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a17614-7fe9-4f9f-9a4c-e1d3b1c7b9ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.521472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21a868-8e78-4ce6-80a3-2cf024f9794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.522123 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21a868-8e78-4ce6-80a3-2cf024f9794c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.522399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21a868-8e78-4ce6-80a3-2cf024f9794c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.522671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21a868-8e78-4ce6-80a3-2cf024f9794c None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.523400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21a868-8e78-4ce6-80a3-2cf024f9794c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:55.523703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21a868-8e78-4ce6-80a3-2cf024f9794c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.525096 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21a868-8e78-4ce6-80a3-2cf024f9794c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:55.536125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 253/510] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:55.536901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21a868-8e78-4ce6-80a3-2cf024f9794c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:55.562272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a17614-7fe9-4f9f-9a4c-e1d3b1c7b9ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.563786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a17614-7fe9-4f9f-9a4c-e1d3b1c7b9ad None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:55.630092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21a868-8e78-4ce6-80a3-2cf024f9794c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.656633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 258/511] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:55.657299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a17614-7fe9-4f9f-9a4c-e1d3b1c7b9ad None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:55.665501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0091b-8534-438e-a45e-8f0290fd39a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.666301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0091b-8534-438e-a45e-8f0290fd39a3 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.666584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0091b-8534-438e-a45e-8f0290fd39a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.666868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0091b-8534-438e-a45e-8f0290fd39a3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.674227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0091b-8534-438e-a45e-8f0290fd39a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.675723 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0091b-8534-438e-a45e-8f0290fd39a3 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-21f0091b-8534-438e-a45e-8f0290fd39a3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:07:55.691280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:55.692167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:55.693051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:55.693051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:55.693051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:07:55.693051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:07:55.693051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:07:55.693051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:07:55.693051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:07:55.693051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:07:55.693051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 17:07:55.693051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:55.693051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 254/512] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:07:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:55.693627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0091b-8534-438e-a45e-8f0290fd39a3 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:55.755345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a17614-7fe9-4f9f-9a4c-e1d3b1c7b9ad None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.787185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb149a41-fd23-441d-bc14-6fe3b27719fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.787984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb149a41-fd23-441d-bc14-6fe3b27719fe None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.788376 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb149a41-fd23-441d-bc14-6fe3b27719fe None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.788655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb149a41-fd23-441d-bc14-6fe3b27719fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.799353 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb149a41-fd23-441d-bc14-6fe3b27719fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.801257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb149a41-fd23-441d-bc14-6fe3b27719fe None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-bb149a41-fd23-441d-bc14-6fe3b27719fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:55.819595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:55.820479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:55.821374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:55.821374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:55.821374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:55.821374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:55.821374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 259/513] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:55.821641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb149a41-fd23-441d-bc14-6fe3b27719fe None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:55.823090 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0091b-8534-438e-a45e-8f0290fd39a3 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.855216 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8b759-e4b9-4c1d-b5b3-799467147075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.855863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8b759-e4b9-4c1d-b5b3-799467147075 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.856152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8b759-e4b9-4c1d-b5b3-799467147075 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.856432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8b759-e4b9-4c1d-b5b3-799467147075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.917198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb149a41-fd23-441d-bc14-6fe3b27719fe None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:55.919682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8b759-e4b9-4c1d-b5b3-799467147075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.921178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8b759-e4b9-4c1d-b5b3-799467147075 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:55.950546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cd2f1-e215-4cb0-9b7b-bba438718200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:55.951337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cd2f1-e215-4cb0-9b7b-bba438718200 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:55.951629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cd2f1-e215-4cb0-9b7b-bba438718200 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:55.951909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cd2f1-e215-4cb0-9b7b-bba438718200 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:55.952619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cd2f1-e215-4cb0-9b7b-bba438718200 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:55.954212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cd2f1-e215-4cb0-9b7b-bba438718200 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:56.015664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 255/514] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:56.016452 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8b759-e4b9-4c1d-b5b3-799467147075 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:56.083955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 260/515] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:07:55 2022] POST /identity/v3/users => generated 247 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:07:56.084797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cd2f1-e215-4cb0-9b7b-bba438718200 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:56.116797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8b759-e4b9-4c1d-b5b3-799467147075 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:56.158551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eddf8c-08c6-4c85-9847-5eb7316b2995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:56.159408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eddf8c-08c6-4c85-9847-5eb7316b2995 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:56.159693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eddf8c-08c6-4c85-9847-5eb7316b2995 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:56.159967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eddf8c-08c6-4c85-9847-5eb7316b2995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:56.171369 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eddf8c-08c6-4c85-9847-5eb7316b2995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:56.172891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eddf8c-08c6-4c85-9847-5eb7316b2995 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-97eddf8c-08c6-4c85-9847-5eb7316b2995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:56.192052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:56.193155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:56.194182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:56.194182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:56.194182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:56.194182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:56.197815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 256/516] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:56.198751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eddf8c-08c6-4c85-9847-5eb7316b2995 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:56.200167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cd2f1-e215-4cb0-9b7b-bba438718200 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:56.239804 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e88b7-c301-4779-84bf-2b149aa8362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:56.240482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e88b7-c301-4779-84bf-2b149aa8362a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:56.240762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e88b7-c301-4779-84bf-2b149aa8362a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:56.241036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e88b7-c301-4779-84bf-2b149aa8362a None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:56.241887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e88b7-c301-4779-84bf-2b149aa8362a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:56.242194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e88b7-c301-4779-84bf-2b149aa8362a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:56.243710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e88b7-c301-4779-84bf-2b149aa8362a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:56.283975 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 261/517] 10.222.0.64 () {56 vars in 1137 bytes} [Fri May 13 17:07:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:56.288271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e88b7-c301-4779-84bf-2b149aa8362a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:56.313348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eddf8c-08c6-4c85-9847-5eb7316b2995 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:56.346219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89e81-dfde-48e6-b7fb-7a1496473681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:56.346874 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89e81-dfde-48e6-b7fb-7a1496473681 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:56.347164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89e81-dfde-48e6-b7fb-7a1496473681 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:56.347431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89e81-dfde-48e6-b7fb-7a1496473681 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:56.348137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89e81-dfde-48e6-b7fb-7a1496473681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:56.348557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89e81-dfde-48e6-b7fb-7a1496473681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:56.349821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89e81-dfde-48e6-b7fb-7a1496473681 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:56.361088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 257/518] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:56.366312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89e81-dfde-48e6-b7fb-7a1496473681 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:56.388412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e88b7-c301-4779-84bf-2b149aa8362a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:56.421436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f999210-8dfc-4f1f-8574-f9fdcbe44708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:56.422226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f999210-8dfc-4f1f-8574-f9fdcbe44708 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:56.422513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f999210-8dfc-4f1f-8574-f9fdcbe44708 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:56.422791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f999210-8dfc-4f1f-8574-f9fdcbe44708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:56.433798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f999210-8dfc-4f1f-8574-f9fdcbe44708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:56.435319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f999210-8dfc-4f1f-8574-f9fdcbe44708 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-6f999210-8dfc-4f1f-8574-f9fdcbe44708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:56.452974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:56.453856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:56.459880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:56.459880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:56.459880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:56.459880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:56.459880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 262/519] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:56.459880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f999210-8dfc-4f1f-8574-f9fdcbe44708 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:56.462085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89e81-dfde-48e6-b7fb-7a1496473681 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:56.496475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8c765-c6d6-484a-b7bf-0e72e92fa554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:56.497147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8c765-c6d6-484a-b7bf-0e72e92fa554 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:56.497433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8c765-c6d6-484a-b7bf-0e72e92fa554 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:56.497710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8c765-c6d6-484a-b7bf-0e72e92fa554 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:56.498423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8c765-c6d6-484a-b7bf-0e72e92fa554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:56.498729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8c765-c6d6-484a-b7bf-0e72e92fa554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:56.500164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8c765-c6d6-484a-b7bf-0e72e92fa554 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:56.515480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 258/520] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:56.516997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8c765-c6d6-484a-b7bf-0e72e92fa554 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:56.557676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f999210-8dfc-4f1f-8574-f9fdcbe44708 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:56.591463 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91cefc-ddf1-443f-9bf9-50ac2caf5915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:56.592113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91cefc-ddf1-443f-9bf9-50ac2caf5915 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:56.592397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91cefc-ddf1-443f-9bf9-50ac2caf5915 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:56.592674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91cefc-ddf1-443f-9bf9-50ac2caf5915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:56.617270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8c765-c6d6-484a-b7bf-0e72e92fa554 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:56.651505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cddc0-3e25-407c-89b0-39222a5384f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:56.652605 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cddc0-3e25-407c-89b0-39222a5384f3 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:56.653059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cddc0-3e25-407c-89b0-39222a5384f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:56.653515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cddc0-3e25-407c-89b0-39222a5384f3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:56.661218 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cddc0-3e25-407c-89b0-39222a5384f3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:56.661532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91cefc-ddf1-443f-9bf9-50ac2caf5915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:56.663026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91cefc-ddf1-443f-9bf9-50ac2caf5915 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:56.663267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cddc0-3e25-407c-89b0-39222a5384f3 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-3a0cddc0-3e25-407c-89b0-39222a5384f3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:07:56.677749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:56.678780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:56.679895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:56.679895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:56.679895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:07:56.679895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:07:56.679895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:07:56.679895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:07:56.679895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:07:56.679895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:07:56.679895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 17:07:56.679895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:56.681750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 259/521] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:07:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:56.682713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cddc0-3e25-407c-89b0-39222a5384f3 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:56.765768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 263/522] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:56.766623 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91cefc-ddf1-443f-9bf9-50ac2caf5915 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:56.787596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cddc0-3e25-407c-89b0-39222a5384f3 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:56.820316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de6c84-582d-4f77-a7aa-4c8b9269e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:56.820913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de6c84-582d-4f77-a7aa-4c8b9269e34b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:56.821203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de6c84-582d-4f77-a7aa-4c8b9269e34b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:56.821477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de6c84-582d-4f77-a7aa-4c8b9269e34b None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:56.822203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de6c84-582d-4f77-a7aa-4c8b9269e34b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:56.822505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de6c84-582d-4f77-a7aa-4c8b9269e34b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:56.824201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de6c84-582d-4f77-a7aa-4c8b9269e34b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:56.840515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 260/523] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:56.840515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de6c84-582d-4f77-a7aa-4c8b9269e34b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:56.875412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91cefc-ddf1-443f-9bf9-50ac2caf5915 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:56.913900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99a936-14bd-42e4-bd21-c375cef3a50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:56.914704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a936-14bd-42e4-bd21-c375cef3a50f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:56.914987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a936-14bd-42e4-bd21-c375cef3a50f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:56.915297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a936-14bd-42e4-bd21-c375cef3a50f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:56.924294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99a936-14bd-42e4-bd21-c375cef3a50f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:56.926211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99a936-14bd-42e4-bd21-c375cef3a50f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-cb99a936-14bd-42e4-bd21-c375cef3a50f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:07:56.941287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:56.942182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:56.943031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:07:56.943031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:07:56.943031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:07:56.943031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:07:56.943031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:07:56.943031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:07:56.943031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:07:56.943031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:56.943031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 264/524] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:56.943987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99a936-14bd-42e4-bd21-c375cef3a50f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:56.952442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de6c84-582d-4f77-a7aa-4c8b9269e34b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:56.989672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be819e-db60-443e-84de-77abc2bac1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:56.990644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be819e-db60-443e-84de-77abc2bac1bf None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:56.991483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be819e-db60-443e-84de-77abc2bac1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:56.991935 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be819e-db60-443e-84de-77abc2bac1bf None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:56.993926 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be819e-db60-443e-84de-77abc2bac1bf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:56.994108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be819e-db60-443e-84de-77abc2bac1bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:56.995880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be819e-db60-443e-84de-77abc2bac1bf None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:57.015151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 261/525] 10.222.0.64 () {56 vars in 1139 bytes} [Fri May 13 17:07:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:57.016000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be819e-db60-443e-84de-77abc2bac1bf None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:57.056286 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99a936-14bd-42e4-bd21-c375cef3a50f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:57.090173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051364a-406b-44a4-b8de-da9294b62fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:57.090924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051364a-406b-44a4-b8de-da9294b62fcf None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:57.091241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051364a-406b-44a4-b8de-da9294b62fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:57.091522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051364a-406b-44a4-b8de-da9294b62fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:57.102545 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051364a-406b-44a4-b8de-da9294b62fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:57.104064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051364a-406b-44a4-b8de-da9294b62fcf None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:57.120928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be819e-db60-443e-84de-77abc2bac1bf None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-f051364a-406b-44a4-b8de-da9294b62fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:57.122548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:57.123506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:57.124338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:57.124338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:57.124338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:57.124338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:57.128444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 265/526] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:57.129429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051364a-406b-44a4-b8de-da9294b62fcf None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:57.159280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda070b-ed34-4a94-95ce-9a2bb5e4ee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:57.160102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda070b-ed34-4a94-95ce-9a2bb5e4ee13 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:57.160391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda070b-ed34-4a94-95ce-9a2bb5e4ee13 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:57.160682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda070b-ed34-4a94-95ce-9a2bb5e4ee13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:57.167499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda070b-ed34-4a94-95ce-9a2bb5e4ee13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:57.169103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda070b-ed34-4a94-95ce-9a2bb5e4ee13 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-9bda070b-ed34-4a94-95ce-9a2bb5e4ee13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:07:57.185035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:57.185919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:57.191775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:07:57.191775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:07:57.191775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:07:57.191775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:07:57.191775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:07:57.191775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:07:57.191775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:07:57.191775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:57.191775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 262/527] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:57.191775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda070b-ed34-4a94-95ce-9a2bb5e4ee13 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:57.244132 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051364a-406b-44a4-b8de-da9294b62fcf None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:57.280631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf06f8-484c-4f10-be3a-d2dca8bf416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:57.281320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf06f8-484c-4f10-be3a-d2dca8bf416d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:57.281610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf06f8-484c-4f10-be3a-d2dca8bf416d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:57.281888 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf06f8-484c-4f10-be3a-d2dca8bf416d None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:57.282704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf06f8-484c-4f10-be3a-d2dca8bf416d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:57.283142 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf06f8-484c-4f10-be3a-d2dca8bf416d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:57.284694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf06f8-484c-4f10-be3a-d2dca8bf416d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:57.309409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 266/528] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:07:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:57.309409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf06f8-484c-4f10-be3a-d2dca8bf416d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:57.316876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda070b-ed34-4a94-95ce-9a2bb5e4ee13 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:57.353993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18820ff-bc34-492a-8040-6bf1ac464e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:57.354572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18820ff-bc34-492a-8040-6bf1ac464e14 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:57.354854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18820ff-bc34-492a-8040-6bf1ac464e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:57.355155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18820ff-bc34-492a-8040-6bf1ac464e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:57.418582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf06f8-484c-4f10-be3a-d2dca8bf416d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:57.428796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18820ff-bc34-492a-8040-6bf1ac464e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:57.430272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18820ff-bc34-492a-8040-6bf1ac464e14 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:57.456516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0d6cb-8fdf-4e6d-ad89-1df7aced63c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:57.457179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d6cb-8fdf-4e6d-ad89-1df7aced63c7 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:57.457463 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d6cb-8fdf-4e6d-ad89-1df7aced63c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:57.457743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d6cb-8fdf-4e6d-ad89-1df7aced63c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:57.458476 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0d6cb-8fdf-4e6d-ad89-1df7aced63c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:57.458779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0d6cb-8fdf-4e6d-ad89-1df7aced63c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:57.460214 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0d6cb-8fdf-4e6d-ad89-1df7aced63c7 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:57.472907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 267/529] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:57.473779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0d6cb-8fdf-4e6d-ad89-1df7aced63c7 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:57.538783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 263/530] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:07:57.540322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18820ff-bc34-492a-8040-6bf1ac464e14 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:57.578712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0d6cb-8fdf-4e6d-ad89-1df7aced63c7 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:57.618329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49687dd9-db8c-43ba-abbf-75050ca0a258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:57.619114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49687dd9-db8c-43ba-abbf-75050ca0a258 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:57.619488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49687dd9-db8c-43ba-abbf-75050ca0a258 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:57.619835 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49687dd9-db8c-43ba-abbf-75050ca0a258 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:57.620711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49687dd9-db8c-43ba-abbf-75050ca0a258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:57.621087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49687dd9-db8c-43ba-abbf-75050ca0a258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:57.622621 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49687dd9-db8c-43ba-abbf-75050ca0a258 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:57.637536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 268/531] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:07:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:57.639170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49687dd9-db8c-43ba-abbf-75050ca0a258 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:57.650560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18820ff-bc34-492a-8040-6bf1ac464e14 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:57.686956 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb600ae8-76e5-45c1-a1d6-81a74d006176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:57.687803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600ae8-76e5-45c1-a1d6-81a74d006176 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:57.688186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600ae8-76e5-45c1-a1d6-81a74d006176 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:57.688562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600ae8-76e5-45c1-a1d6-81a74d006176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:57.689634 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb600ae8-76e5-45c1-a1d6-81a74d006176 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=efbbecde248c44c7b1d5f3c9522a48a2) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:57.689940 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb600ae8-76e5-45c1-a1d6-81a74d006176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:57.691533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb600ae8-76e5-45c1-a1d6-81a74d006176 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:57.707477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 264/532] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:57 2022] GET /identity/v3/role_assignments?user.id=efbbecde248c44c7b1d5f3c9522a48a2&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:57.707477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb600ae8-76e5-45c1-a1d6-81a74d006176 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:57.750905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49687dd9-db8c-43ba-abbf-75050ca0a258 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:57.787831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68b15-6d55-4ab3-b4ca-db276e127894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:57.788673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68b15-6d55-4ab3-b4ca-db276e127894 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:57.788959 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68b15-6d55-4ab3-b4ca-db276e127894 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:57.789239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68b15-6d55-4ab3-b4ca-db276e127894 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:57.796778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68b15-6d55-4ab3-b4ca-db276e127894 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:57.798320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68b15-6d55-4ab3-b4ca-db276e127894 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-cfe68b15-6d55-4ab3-b4ca-db276e127894 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:07:57.815475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:57.816502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:57.817365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:07:57.817365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:07:57.817365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:07:57.817365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:07:57.817365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:07:57.817365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:07:57.817365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:07:57.817365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:57.821555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 269/533] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:57.822534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68b15-6d55-4ab3-b4ca-db276e127894 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:57.824139 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb600ae8-76e5-45c1-a1d6-81a74d006176 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:57.869696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25ddaa-7cfb-476b-8308-009756cd3167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:57.870512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25ddaa-7cfb-476b-8308-009756cd3167 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:57.870799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25ddaa-7cfb-476b-8308-009756cd3167 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:57.871078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25ddaa-7cfb-476b-8308-009756cd3167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:57.885294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25ddaa-7cfb-476b-8308-009756cd3167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:57.886924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25ddaa-7cfb-476b-8308-009756cd3167 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-ba25ddaa-7cfb-476b-8308-009756cd3167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:57.906448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:57.907424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:57.908373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:57.908373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:57.908373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:57.908373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:57.912498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 265/534] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:57.913454 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25ddaa-7cfb-476b-8308-009756cd3167 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:57.934133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68b15-6d55-4ab3-b4ca-db276e127894 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:57.981118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517acc4-82de-4a82-9d91-5b09ec6c2d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:57.982655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517acc4-82de-4a82-9d91-5b09ec6c2d5c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:57.983547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517acc4-82de-4a82-9d91-5b09ec6c2d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:57.984040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517acc4-82de-4a82-9d91-5b09ec6c2d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:57.985614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517acc4-82de-4a82-9d91-5b09ec6c2d5c None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=8e00de466abe41da8e6d7dbbd71f5270) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:57.987027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517acc4-82de-4a82-9d91-5b09ec6c2d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:57.989201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517acc4-82de-4a82-9d91-5b09ec6c2d5c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:57.998193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 270/535] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:57 2022] GET /identity/v3/role_assignments?user.id=8e00de466abe41da8e6d7dbbd71f5270&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:58.009771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517acc4-82de-4a82-9d91-5b09ec6c2d5c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:58.077457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25ddaa-7cfb-476b-8308-009756cd3167 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:58.151437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2690de-3a70-49df-ad8f-e03bb0768d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:58.152404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2690de-3a70-49df-ad8f-e03bb0768d6b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:58.153582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2690de-3a70-49df-ad8f-e03bb0768d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:58.154645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2690de-3a70-49df-ad8f-e03bb0768d6b None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:58.155929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2690de-3a70-49df-ad8f-e03bb0768d6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:58.158437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2690de-3a70-49df-ad8f-e03bb0768d6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:58.160191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2690de-3a70-49df-ad8f-e03bb0768d6b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:58.160423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517acc4-82de-4a82-9d91-5b09ec6c2d5c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:58.192634 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 266/536] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:07:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:58.198808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2690de-3a70-49df-ad8f-e03bb0768d6b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:58.240666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27d238-2ed0-4b9f-a733-4eaa9a7f3440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:58.242186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27d238-2ed0-4b9f-a733-4eaa9a7f3440 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:58.242186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27d238-2ed0-4b9f-a733-4eaa9a7f3440 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:58.242186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27d238-2ed0-4b9f-a733-4eaa9a7f3440 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:58.242651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27d238-2ed0-4b9f-a733-4eaa9a7f3440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:58.242963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27d238-2ed0-4b9f-a733-4eaa9a7f3440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:58.244423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27d238-2ed0-4b9f-a733-4eaa9a7f3440 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:58.257835 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 271/537] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:58.268980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27d238-2ed0-4b9f-a733-4eaa9a7f3440 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:58.345929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2690de-3a70-49df-ad8f-e03bb0768d6b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:58.372518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27d238-2ed0-4b9f-a733-4eaa9a7f3440 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:58.405225 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d6243-78a0-4946-b75a-912db33fb93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:58.406180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d6243-78a0-4946-b75a-912db33fb93a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:58.406543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d6243-78a0-4946-b75a-912db33fb93a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:58.406823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d6243-78a0-4946-b75a-912db33fb93a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:58.407700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d6243-78a0-4946-b75a-912db33fb93a None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=cd116be69d7f4cffb770940ccb7514fa) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:58.408551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d6243-78a0-4946-b75a-912db33fb93a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:58.410080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d6243-78a0-4946-b75a-912db33fb93a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:58.410812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe443dc-bdac-424d-8c05-65523d9ab093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:58.411852 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe443dc-bdac-424d-8c05-65523d9ab093 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:58.412319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe443dc-bdac-424d-8c05-65523d9ab093 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:58.412773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe443dc-bdac-424d-8c05-65523d9ab093 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:58.420080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe443dc-bdac-424d-8c05-65523d9ab093 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:58.422213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe443dc-bdac-424d-8c05-65523d9ab093 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:58.422736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 267/538] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:58 2022] GET /identity/v3/role_assignments?user.id=cd116be69d7f4cffb770940ccb7514fa&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:58.424737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f718b-9b7d-435f-8b78-0170d64708d0 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:58.425027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f718b-9b7d-435f-8b78-0170d64708d0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:58.425358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f718b-9b7d-435f-8b78-0170d64708d0 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:58.426884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 268/539] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-7fe443dc-bdac-424d-8c05-65523d9ab093 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:07:58.437383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:58.438299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:58.439889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:07:58.439889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:07:58.439889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:07:58.439889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:07:58.439889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:07:58.439889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:07:58.439889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:07:58.439889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:58.439889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 272/540] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:58.444557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919061f-3ac4-4e37-804e-8034dd4d54fb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:58.444866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919061f-3ac4-4e37-804e-8034dd4d54fb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:58.445135 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919061f-3ac4-4e37-804e-8034dd4d54fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:58.448347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe443dc-bdac-424d-8c05-65523d9ab093 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:58.463535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3919061f-3ac4-4e37-804e-8034dd4d54fb None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:07:58.464785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3919061f-3ac4-4e37-804e-8034dd4d54fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:07:58.536271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 269/541] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:07:58.567348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919061f-3ac4-4e37-804e-8034dd4d54fb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:58.589404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe443dc-bdac-424d-8c05-65523d9ab093 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:58.625357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b445e-8d3c-47da-a4b8-6d00b218a48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:58.626040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b445e-8d3c-47da-a4b8-6d00b218a48a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:58.626329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b445e-8d3c-47da-a4b8-6d00b218a48a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:58.626607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b445e-8d3c-47da-a4b8-6d00b218a48a None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:58.627499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b445e-8d3c-47da-a4b8-6d00b218a48a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:58.627811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b445e-8d3c-47da-a4b8-6d00b218a48a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:58.629297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b445e-8d3c-47da-a4b8-6d00b218a48a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:58.642220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 273/542] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:07:58.647691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b445e-8d3c-47da-a4b8-6d00b218a48a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:58.722317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919061f-3ac4-4e37-804e-8034dd4d54fb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:58.763594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9efeb-b556-43c8-97af-6872c9a662c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:58.764405 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9efeb-b556-43c8-97af-6872c9a662c0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:58.764687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9efeb-b556-43c8-97af-6872c9a662c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:58.764964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9efeb-b556-43c8-97af-6872c9a662c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:58.781594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9efeb-b556-43c8-97af-6872c9a662c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-6de9efeb-b556-43c8-97af-6872c9a662c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:07:58.790887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:58.791824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:07:58.793063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 270/543] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:07:58.799714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9efeb-b556-43c8-97af-6872c9a662c0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:58.854710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b445e-8d3c-47da-a4b8-6d00b218a48a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:58.923935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2269a5-57f3-4ae1-aec4-408ab5ecfcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:58.924596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2269a5-57f3-4ae1-aec4-408ab5ecfcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:58.924881 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2269a5-57f3-4ae1-aec4-408ab5ecfcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:58.925159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2269a5-57f3-4ae1-aec4-408ab5ecfcd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:58.928455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2269a5-57f3-4ae1-aec4-408ab5ecfcd7 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=d99855838f77462886cc87db440e1037) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:58.928780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2269a5-57f3-4ae1-aec4-408ab5ecfcd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:58.931588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2269a5-57f3-4ae1-aec4-408ab5ecfcd7 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:58.941123 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9efeb-b556-43c8-97af-6872c9a662c0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:58.944598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 274/544] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:07:58 2022] GET /identity/v3/role_assignments?user.id=d99855838f77462886cc87db440e1037&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:58.982824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc939b-a2d8-4708-bb6f-6dc5b227cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:58.983611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc939b-a2d8-4708-bb6f-6dc5b227cf9e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:58.984111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc939b-a2d8-4708-bb6f-6dc5b227cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:58.984399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc939b-a2d8-4708-bb6f-6dc5b227cf9e None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:58.985187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc939b-a2d8-4708-bb6f-6dc5b227cf9e None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:58.985508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc939b-a2d8-4708-bb6f-6dc5b227cf9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:58.987117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc939b-a2d8-4708-bb6f-6dc5b227cf9e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:58.996582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 271/545] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:59.014839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2269a5-57f3-4ae1-aec4-408ab5ecfcd7 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:59.185911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2269a5-57f3-4ae1-aec4-408ab5ecfcd7 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:59.226644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87554f-e7a4-439a-a8b8-7e27eb516cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:59.227481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87554f-e7a4-439a-a8b8-7e27eb516cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:59.227768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87554f-e7a4-439a-a8b8-7e27eb516cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:59.228043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87554f-e7a4-439a-a8b8-7e27eb516cb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:59.239262 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87554f-e7a4-439a-a8b8-7e27eb516cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:59.240722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87554f-e7a4-439a-a8b8-7e27eb516cb4 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-0b87554f-e7a4-439a-a8b8-7e27eb516cb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:07:59.262594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:59.263611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:59.264482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:07:59.264482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:07:59.264482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:07:59.264482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:59.264482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 275/546] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:59.269746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc939b-a2d8-4708-bb6f-6dc5b227cf9e None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:59.391713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc939b-a2d8-4708-bb6f-6dc5b227cf9e None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:59.426725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c0192-ad91-4fce-bf7b-3e695787969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:59.427779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c0192-ad91-4fce-bf7b-3e695787969f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:59.428352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c0192-ad91-4fce-bf7b-3e695787969f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:59.428827 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c0192-ad91-4fce-bf7b-3e695787969f None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:59.429838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c0192-ad91-4fce-bf7b-3e695787969f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:59.430342 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c0192-ad91-4fce-bf7b-3e695787969f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:59.431968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c0192-ad91-4fce-bf7b-3e695787969f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:59.444771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 272/547] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:59.450219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87554f-e7a4-439a-a8b8-7e27eb516cb4 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:59.612478 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87554f-e7a4-439a-a8b8-7e27eb516cb4 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:59.660337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122738-e4ae-4307-b4d0-092c037e1129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:59.661134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122738-e4ae-4307-b4d0-092c037e1129 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:59.661421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122738-e4ae-4307-b4d0-092c037e1129 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:59.661700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122738-e4ae-4307-b4d0-092c037e1129 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:59.672163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39122738-e4ae-4307-b4d0-092c037e1129 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:59.673658 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39122738-e4ae-4307-b4d0-092c037e1129 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-39122738-e4ae-4307-b4d0-092c037e1129 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:07:59.691354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:07:59.692243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:07:59.693131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:07:59.693131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:07:59.693131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:07:59.693131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:07:59.693131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:07:59.693131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:07:59.693131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:07:59.693131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:07:59.693131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 17:07:59.693131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:07:59.693131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 276/548] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:07:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:07:59.698107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c0192-ad91-4fce-bf7b-3e695787969f None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:07:59.842638 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c0192-ad91-4fce-bf7b-3e695787969f None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:07:59.892888 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff6610-e445-4580-a1ee-50563a2275f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:07:59.893496 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff6610-e445-4580-a1ee-50563a2275f9 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:07:59.893782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff6610-e445-4580-a1ee-50563a2275f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:07:59.894059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff6610-e445-4580-a1ee-50563a2275f9 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:07:59.894914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff6610-e445-4580-a1ee-50563a2275f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:07:59.895253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff6610-e445-4580-a1ee-50563a2275f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:07:59.896728 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff6610-e445-4580-a1ee-50563a2275f9 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:07:59.921439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 273/549] 10.222.0.64 () {56 vars in 1135 bytes} [Fri May 13 17:07:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:07:59.927581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122738-e4ae-4307-b4d0-092c037e1129 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:00.119479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122738-e4ae-4307-b4d0-092c037e1129 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:00.169307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78591-7461-45da-bec1-1d22cd70040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:00.169882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78591-7461-45da-bec1-1d22cd70040f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:00.170169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78591-7461-45da-bec1-1d22cd70040f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:00.170443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78591-7461-45da-bec1-1d22cd70040f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:00.261884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b78591-7461-45da-bec1-1d22cd70040f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:00.263492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b78591-7461-45da-bec1-1d22cd70040f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:00.414262 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 277/550] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:07:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:08:00.419640 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff6610-e445-4580-a1ee-50563a2275f9 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:00.577308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff6610-e445-4580-a1ee-50563a2275f9 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:00.619378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc8ef3-0487-4850-b3bd-2a7d58e7fade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:00.620244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc8ef3-0487-4850-b3bd-2a7d58e7fade None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:00.620533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc8ef3-0487-4850-b3bd-2a7d58e7fade None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:00.620813 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc8ef3-0487-4850-b3bd-2a7d58e7fade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:00.640365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc8ef3-0487-4850-b3bd-2a7d58e7fade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:00.641873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc8ef3-0487-4850-b3bd-2a7d58e7fade None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-64fc8ef3-0487-4850-b3bd-2a7d58e7fade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:00.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:00.668340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:00.669196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:00.669196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:00.669196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:00.669196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:00.669196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 274/551] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:00.675438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78591-7461-45da-bec1-1d22cd70040f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:00.739613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2376181-8fbe-4569-ba6a-cc06fa1b65c2 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:00.740319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2376181-8fbe-4569-ba6a-cc06fa1b65c2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:00.740319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2376181-8fbe-4569-ba6a-cc06fa1b65c2 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:00.741672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 275/552] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:00.746645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cfb1e-61d1-45e7-b3fc-1f68ad28b3b2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:00.746930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cfb1e-61d1-45e7-b3fc-1f68ad28b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:00.747233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cfb1e-61d1-45e7-b3fc-1f68ad28b3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:00.775593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-862cfb1e-61d1-45e7-b3fc-1f68ad28b3b2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:00.776799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-862cfb1e-61d1-45e7-b3fc-1f68ad28b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:00.796160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78591-7461-45da-bec1-1d22cd70040f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:00.838763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b60c6b-badf-428d-8656-18d0c9399779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:00.839544 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b60c6b-badf-428d-8656-18d0c9399779 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:00.839879 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b60c6b-badf-428d-8656-18d0c9399779 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:00.840164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b60c6b-badf-428d-8656-18d0c9399779 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:00.840902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b60c6b-badf-428d-8656-18d0c9399779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:00.841213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b60c6b-badf-428d-8656-18d0c9399779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:00.842622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b60c6b-badf-428d-8656-18d0c9399779 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:00.862936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 278/553] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:00.864850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b60c6b-badf-428d-8656-18d0c9399779 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:00.885088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 276/554] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:00.886741 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df613c4-b174-416b-b9a9-5628d17fcbd4 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:00.887298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df613c4-b174-416b-b9a9-5628d17fcbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:00.887775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df613c4-b174-416b-b9a9-5628d17fcbd4 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:00.889474 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 277/555] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:00.894787 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48f90-e27d-46a7-bfc4-eb3fe5f4369b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:00.895358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48f90-e27d-46a7-bfc4-eb3fe5f4369b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:00.895861 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48f90-e27d-46a7-bfc4-eb3fe5f4369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:00.913293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f3d48f90-e27d-46a7-bfc4-eb3fe5f4369b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:00.914794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f3d48f90-e27d-46a7-bfc4-eb3fe5f4369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:00.974773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b60c6b-badf-428d-8656-18d0c9399779 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:01.015203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 278/556] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:08:01.016193 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48f90-e27d-46a7-bfc4-eb3fe5f4369b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:01.022421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e5494-5472-4188-bae8-c5744922c971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:01.023682 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e5494-5472-4188-bae8-c5744922c971 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.024165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e5494-5472-4188-bae8-c5744922c971 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.024674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e5494-5472-4188-bae8-c5744922c971 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.034578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e5494-5472-4188-bae8-c5744922c971 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:01.036485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e5494-5472-4188-bae8-c5744922c971 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-6f8e5494-5472-4188-bae8-c5744922c971 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:01.055954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:01.056892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:01.057712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:01.057712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:01.057712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:01.057712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:01.057712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:01.057712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:01.057712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:01.057712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:01.064798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 279/557] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:01.064798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e5494-5472-4188-bae8-c5744922c971 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:01.160563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48f90-e27d-46a7-bfc4-eb3fe5f4369b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:01.170211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e5494-5472-4188-bae8-c5744922c971 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:01.204467 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ec5c-e8aa-4e17-85d5-83f9396f12f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:01.206098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134841cc-0143-422c-be94-33e6255bf3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:01.206462 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ec5c-e8aa-4e17-85d5-83f9396f12f4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.206924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ec5c-e8aa-4e17-85d5-83f9396f12f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.207082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134841cc-0143-422c-be94-33e6255bf3aa None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.207552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ec5c-e8aa-4e17-85d5-83f9396f12f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.207890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134841cc-0143-422c-be94-33e6255bf3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.208466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134841cc-0143-422c-be94-33e6255bf3aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.222021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134841cc-0143-422c-be94-33e6255bf3aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:01.222901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93ec5c-e8aa-4e17-85d5-83f9396f12f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-134841cc-0143-422c-be94-33e6255bf3aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:01.230304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:01.231460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:01.232506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-ea93ec5c-e8aa-4e17-85d5-83f9396f12f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:01.233150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:01.234272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 279/559] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:01.236288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ec5c-e8aa-4e17-85d5-83f9396f12f4 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:01.238363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 280/559] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:01.238509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58e9ec-40c0-4f12-bf32-97a2bfd715cc None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.238742 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58e9ec-40c0-4f12-bf32-97a2bfd715cc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.239026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58e9ec-40c0-4f12-bf32-97a2bfd715cc None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.240498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 281/560] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:01.241193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58e9ec-40c0-4f12-bf32-97a2bfd715cc None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:01.341870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ec5c-e8aa-4e17-85d5-83f9396f12f4 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:01.342103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58e9ec-40c0-4f12-bf32-97a2bfd715cc None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:01.374584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bb882-dffa-4767-bdbc-694f1b7a5ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:01.375270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb882-dffa-4767-bdbc-694f1b7a5ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.375548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb882-dffa-4767-bdbc-694f1b7a5ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.376063 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb882-dffa-4767-bdbc-694f1b7a5ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.376224 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191604f-880e-4894-b64f-31c6adc3afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:01.376546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bb882-dffa-4767-bdbc-694f1b7a5ca5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:01.377328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191604f-880e-4894-b64f-31c6adc3afd2 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.377440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bb882-dffa-4767-bdbc-694f1b7a5ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:01.377614 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191604f-880e-4894-b64f-31c6adc3afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.377890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191604f-880e-4894-b64f-31c6adc3afd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.378674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191604f-880e-4894-b64f-31c6adc3afd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:01.378765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bb882-dffa-4767-bdbc-694f1b7a5ca5 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:01.378983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191604f-880e-4894-b64f-31c6adc3afd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:01.380487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191604f-880e-4894-b64f-31c6adc3afd2 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:01.391164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 282/561] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:01.391164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bb882-dffa-4767-bdbc-694f1b7a5ca5 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:01.397237 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 280/562] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:01.398559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac785-c301-44d7-9dca-b002e2662db2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.398854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac785-c301-44d7-9dca-b002e2662db2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.399150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac785-c301-44d7-9dca-b002e2662db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.415082 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8b8ac785-c301-44d7-9dca-b002e2662db2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:01.416393 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8b8ac785-c301-44d7-9dca-b002e2662db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:01.478887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 281/563] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:01.480235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aafbd-2f29-436c-af19-455a81f15ac9 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.480577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aafbd-2f29-436c-af19-455a81f15ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.480802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aafbd-2f29-436c-af19-455a81f15ac9 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.482233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 282/564] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:01.482754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aafbd-2f29-436c-af19-455a81f15ac9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:01.486907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bb882-dffa-4767-bdbc-694f1b7a5ca5 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:01.520002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0a55a-1280-41e8-bd93-818cd4de19c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:01.520664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0a55a-1280-41e8-bd93-818cd4de19c2 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.520947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0a55a-1280-41e8-bd93-818cd4de19c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.521223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0a55a-1280-41e8-bd93-818cd4de19c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.521964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0a55a-1280-41e8-bd93-818cd4de19c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:01.522269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0a55a-1280-41e8-bd93-818cd4de19c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:01.523681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0a55a-1280-41e8-bd93-818cd4de19c2 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:01.532566 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 283/565] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:01.533897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0a55a-1280-41e8-bd93-818cd4de19c2 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:01.593108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aafbd-2f29-436c-af19-455a81f15ac9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:01.624279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e7c06-a2b9-4b51-b9b8-eff950551d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:01.625052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e7c06-a2b9-4b51-b9b8-eff950551d55 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.625326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e7c06-a2b9-4b51-b9b8-eff950551d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.625594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e7c06-a2b9-4b51-b9b8-eff950551d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.631676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0a55a-1280-41e8-bd93-818cd4de19c2 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:01.635594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e7c06-a2b9-4b51-b9b8-eff950551d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:01.637050 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e7c06-a2b9-4b51-b9b8-eff950551d55 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-ff7e7c06-a2b9-4b51-b9b8-eff950551d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:01.654336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:01.655435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:01.656370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:01.656370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:01.656370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:01.656370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:01.656370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 283/566] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:01.657084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062e0bc-c0a1-4cbb-bbbb-f9753bf4a17a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.657366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062e0bc-c0a1-4cbb-bbbb-f9753bf4a17a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.657639 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062e0bc-c0a1-4cbb-bbbb-f9753bf4a17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.667319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dc8c1-5132-4e95-831c-87efcc9418b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:01.667979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc8c1-5132-4e95-831c-87efcc9418b1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.668261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc8c1-5132-4e95-831c-87efcc9418b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.668540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc8c1-5132-4e95-831c-87efcc9418b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.669373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dc8c1-5132-4e95-831c-87efcc9418b1 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=973cc524d553428aa2b2763ce28cc920) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:01.669685 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dc8c1-5132-4e95-831c-87efcc9418b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:01.671153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dc8c1-5132-4e95-831c-87efcc9418b1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:01.673203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1062e0bc-c0a1-4cbb-bbbb-f9753bf4a17a None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:01.674389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1062e0bc-c0a1-4cbb-bbbb-f9753bf4a17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:01.676393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 284/567] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/role_assignments?user.id=973cc524d553428aa2b2763ce28cc920&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:01.677154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dc8c1-5132-4e95-831c-87efcc9418b1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:01.746795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 284/568] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:01.747361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062e0bc-c0a1-4cbb-bbbb-f9753bf4a17a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:01.781345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dc8c1-5132-4e95-831c-87efcc9418b1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:01.816676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba191c66-f9ad-486a-a335-9f8041f70c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:01.817604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba191c66-f9ad-486a-a335-9f8041f70c5b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.817978 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba191c66-f9ad-486a-a335-9f8041f70c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.818318 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba191c66-f9ad-486a-a335-9f8041f70c5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.830181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba191c66-f9ad-486a-a335-9f8041f70c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-ba191c66-f9ad-486a-a335-9f8041f70c5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:01.838213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:01.839539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 285/569] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:01.840454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba191c66-f9ad-486a-a335-9f8041f70c5b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:01.855015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062e0bc-c0a1-4cbb-bbbb-f9753bf4a17a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:01.892397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227b8a1-806d-4edd-82bc-bf5de32208d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:01.893197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227b8a1-806d-4edd-82bc-bf5de32208d5 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.893479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227b8a1-806d-4edd-82bc-bf5de32208d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.893751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227b8a1-806d-4edd-82bc-bf5de32208d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.904148 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227b8a1-806d-4edd-82bc-bf5de32208d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:01.905644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227b8a1-806d-4edd-82bc-bf5de32208d5 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-b227b8a1-806d-4edd-82bc-bf5de32208d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:01.922995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:01.924495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:01.925379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:01.925379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:01.925379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:01.925379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:01.925379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 285/570] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:01.925656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227b8a1-806d-4edd-82bc-bf5de32208d5 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:01.943234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba191c66-f9ad-486a-a335-9f8041f70c5b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:01.976405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fd193-de86-412e-ad6a-ce8f442925e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:01.977074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fd193-de86-412e-ad6a-ce8f442925e3 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:01.977367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fd193-de86-412e-ad6a-ce8f442925e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:01.977649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fd193-de86-412e-ad6a-ce8f442925e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:01.978366 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fd193-de86-412e-ad6a-ce8f442925e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:01.978673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fd193-de86-412e-ad6a-ce8f442925e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:01.980098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fd193-de86-412e-ad6a-ce8f442925e3 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:01.992317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 286/571] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:01.993153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fd193-de86-412e-ad6a-ce8f442925e3 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.042251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227b8a1-806d-4edd-82bc-bf5de32208d5 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.077080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703feae8-627d-4f87-b48d-e00352427163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.077952 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703feae8-627d-4f87-b48d-e00352427163 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.078177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703feae8-627d-4f87-b48d-e00352427163 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.078421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703feae8-627d-4f87-b48d-e00352427163 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.088306 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703feae8-627d-4f87-b48d-e00352427163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:02.092571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fd193-de86-412e-ad6a-ce8f442925e3 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-703feae8-627d-4f87-b48d-e00352427163 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:02.095994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:02.096944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 286/572] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:02.103426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703feae8-627d-4f87-b48d-e00352427163 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.125845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe7c9a-61c8-4ba9-aa55-4c61b50afe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.126516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe7c9a-61c8-4ba9-aa55-4c61b50afe58 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.127377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe7c9a-61c8-4ba9-aa55-4c61b50afe58 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.127663 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe7c9a-61c8-4ba9-aa55-4c61b50afe58 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.128410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe7c9a-61c8-4ba9-aa55-4c61b50afe58 None admin] RBAC: Adding query filter params (name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:02.128718 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe7c9a-61c8-4ba9-aa55-4c61b50afe58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:02.130089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe7c9a-61c8-4ba9-aa55-4c61b50afe58 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:02.138017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 287/573] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:02.143056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe7c9a-61c8-4ba9-aa55-4c61b50afe58 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.202970 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703feae8-627d-4f87-b48d-e00352427163 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.236889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d668f-1621-400c-8e1a-f567a7ddd6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.237551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d668f-1621-400c-8e1a-f567a7ddd6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.237838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d668f-1621-400c-8e1a-f567a7ddd6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.238113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d668f-1621-400c-8e1a-f567a7ddd6e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.238834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d668f-1621-400c-8e1a-f567a7ddd6e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:02.239154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d668f-1621-400c-8e1a-f567a7ddd6e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:02.240592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d668f-1621-400c-8e1a-f567a7ddd6e1 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:02.241406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe7c9a-61c8-4ba9-aa55-4c61b50afe58 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.256776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 287/574] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:02.257586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d668f-1621-400c-8e1a-f567a7ddd6e1 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.274874 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff65559-e04b-40d1-aa06-1ba44a6ff3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.276003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65559-e04b-40d1-aa06-1ba44a6ff3ad None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.276352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65559-e04b-40d1-aa06-1ba44a6ff3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.276695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65559-e04b-40d1-aa06-1ba44a6ff3ad None admin] PATH_INFO: `/v3/users/glance` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.284910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff65559-e04b-40d1-aa06-1ba44a6ff3ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:02.286374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff65559-e04b-40d1-aa06-1ba44a6ff3ad None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-6ff65559-e04b-40d1-aa06-1ba44a6ff3ad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:02.304608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:02.305745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:02.306723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:02.306723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:02.306723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:02.306723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:02.306723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:02.306723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:02.306723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:02.306723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:02.306723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 17:08:02.306723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:02.306723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 288/575] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:02.307636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff65559-e04b-40d1-aa06-1ba44a6ff3ad None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.360197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d668f-1621-400c-8e1a-f567a7ddd6e1 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.393262 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc2717-575b-4ca9-a776-328c1110f589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.393929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc2717-575b-4ca9-a776-328c1110f589 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.394213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc2717-575b-4ca9-a776-328c1110f589 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.394481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc2717-575b-4ca9-a776-328c1110f589 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.395251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc2717-575b-4ca9-a776-328c1110f589 None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:02.395560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc2717-575b-4ca9-a776-328c1110f589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:02.396946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc2717-575b-4ca9-a776-328c1110f589 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:02.409870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 288/576] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:02.409870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc2717-575b-4ca9-a776-328c1110f589 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.417301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff65559-e04b-40d1-aa06-1ba44a6ff3ad None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.450860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334101-5d34-4a26-8271-ea947db1abbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.451678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334101-5d34-4a26-8271-ea947db1abbb None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.451961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334101-5d34-4a26-8271-ea947db1abbb None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.452235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334101-5d34-4a26-8271-ea947db1abbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.462509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10334101-5d34-4a26-8271-ea947db1abbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:02.463997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10334101-5d34-4a26-8271-ea947db1abbb None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-10334101-5d34-4a26-8271-ea947db1abbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:02.481639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:02.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:02.483552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:02.483552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:02.483552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:02.483552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:02.487449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 289/577] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:02.488562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334101-5d34-4a26-8271-ea947db1abbb None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.503408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc2717-575b-4ca9-a776-328c1110f589 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.552839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e42fbe-4453-46ad-a088-406b55fccbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.553650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42fbe-4453-46ad-a088-406b55fccbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.553938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42fbe-4453-46ad-a088-406b55fccbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.554221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42fbe-4453-46ad-a088-406b55fccbd0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.563796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e42fbe-4453-46ad-a088-406b55fccbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:02.563796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e42fbe-4453-46ad-a088-406b55fccbd0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-84e42fbe-4453-46ad-a088-406b55fccbd0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:02.578558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:02.579543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:02.580505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:02.580505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:02.580505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:02.580505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:02.580505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:02.580505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:02.580505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:02.580505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:02.580505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:02.580505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:02.580505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 289/578] 10.222.0.64 () {56 vars in 1093 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:02.581078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e42fbe-4453-46ad-a088-406b55fccbd0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.597189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334101-5d34-4a26-8271-ea947db1abbb None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.630278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9c677-6efe-407a-88ce-034f47f74523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.630933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c677-6efe-407a-88ce-034f47f74523 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.631252 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c677-6efe-407a-88ce-034f47f74523 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.631530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c677-6efe-407a-88ce-034f47f74523 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.632370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9c677-6efe-407a-88ce-034f47f74523 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:02.632678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9c677-6efe-407a-88ce-034f47f74523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:02.634117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9c677-6efe-407a-88ce-034f47f74523 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:02.654773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 290/579] 10.222.0.64 () {56 vars in 1137 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:02.654773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9c677-6efe-407a-88ce-034f47f74523 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.676666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e42fbe-4453-46ad-a088-406b55fccbd0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.709950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d8334-76fa-4786-9512-a7f89ef84335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.710750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8334-76fa-4786-9512-a7f89ef84335 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.711034 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8334-76fa-4786-9512-a7f89ef84335 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.711345 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8334-76fa-4786-9512-a7f89ef84335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.722635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d8334-76fa-4786-9512-a7f89ef84335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:02.724141 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d8334-76fa-4786-9512-a7f89ef84335 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-ea6d8334-76fa-4786-9512-a7f89ef84335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:02.741686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:02.742606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:02.743564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:02.743564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:02.743564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:02.743564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:02.747311 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 290/580] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:02.748053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d8334-76fa-4786-9512-a7f89ef84335 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.750295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9c677-6efe-407a-88ce-034f47f74523 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.783363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29fef1-a35d-45a9-b9f4-d1787f9a400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.784047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29fef1-a35d-45a9-b9f4-d1787f9a400c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.784354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29fef1-a35d-45a9-b9f4-d1787f9a400c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.784610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29fef1-a35d-45a9-b9f4-d1787f9a400c None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.785351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29fef1-a35d-45a9-b9f4-d1787f9a400c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:02.785661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29fef1-a35d-45a9-b9f4-d1787f9a400c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:02.787066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29fef1-a35d-45a9-b9f4-d1787f9a400c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:02.803698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 291/581] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:02.803698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29fef1-a35d-45a9-b9f4-d1787f9a400c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.855592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d8334-76fa-4786-9512-a7f89ef84335 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.889235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebbdd2-8792-4e40-afec-1e36557e1c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.889916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebbdd2-8792-4e40-afec-1e36557e1c6d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.890202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebbdd2-8792-4e40-afec-1e36557e1c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.890485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebbdd2-8792-4e40-afec-1e36557e1c6d None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.891347 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebbdd2-8792-4e40-afec-1e36557e1c6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:02.891659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebbdd2-8792-4e40-afec-1e36557e1c6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:02.893146 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebbdd2-8792-4e40-afec-1e36557e1c6d None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:02.907798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29fef1-a35d-45a9-b9f4-d1787f9a400c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:02.911196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 291/582] 10.222.0.64 () {56 vars in 1133 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:02.911945 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebbdd2-8792-4e40-afec-1e36557e1c6d None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:02.945076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a02e2-20cb-421d-a26e-7dfd70a05bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:02.945841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a02e2-20cb-421d-a26e-7dfd70a05bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:02.946116 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a02e2-20cb-421d-a26e-7dfd70a05bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:02.946393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a02e2-20cb-421d-a26e-7dfd70a05bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:02.961181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a02e2-20cb-421d-a26e-7dfd70a05bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:02.963425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a02e2-20cb-421d-a26e-7dfd70a05bf1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-188a02e2-20cb-421d-a26e-7dfd70a05bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:02.988471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:02.989610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:02.990500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:02.990500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:02.990500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:02.990500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:02.990500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 292/583] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:02.990500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a02e2-20cb-421d-a26e-7dfd70a05bf1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.023250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebbdd2-8792-4e40-afec-1e36557e1c6d None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.058639 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349d33d-dce6-4826-b024-72d326ad0acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.059070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349d33d-dce6-4826-b024-72d326ad0acf None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.059401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349d33d-dce6-4826-b024-72d326ad0acf None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.059681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349d33d-dce6-4826-b024-72d326ad0acf None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.060463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349d33d-dce6-4826-b024-72d326ad0acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:03.060772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349d33d-dce6-4826-b024-72d326ad0acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.062548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349d33d-dce6-4826-b024-72d326ad0acf None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.074398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 292/584] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:03.075843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349d33d-dce6-4826-b024-72d326ad0acf None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.091421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a02e2-20cb-421d-a26e-7dfd70a05bf1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.125441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c93a-78ef-4000-b08e-850e4f363980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.126231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c93a-78ef-4000-b08e-850e4f363980 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.126517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c93a-78ef-4000-b08e-850e4f363980 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.126885 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c93a-78ef-4000-b08e-850e4f363980 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.137855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c93a-78ef-4000-b08e-850e4f363980 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.139378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c93a-78ef-4000-b08e-850e4f363980 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-0f64c93a-78ef-4000-b08e-850e4f363980 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:03.162098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:03.163186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:03.164162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:03.164162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:03.164162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:03.164162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:03.164162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:03.164162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:03.164162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:03.164162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:03.164162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 17:08:03.164162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:03.168536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 293/585] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:03.169379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c93a-78ef-4000-b08e-850e4f363980 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.185359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349d33d-dce6-4826-b024-72d326ad0acf None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.226433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054920bf-d7fb-48a8-868e-e04dbf9b5262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.227250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054920bf-d7fb-48a8-868e-e04dbf9b5262 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.227537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054920bf-d7fb-48a8-868e-e04dbf9b5262 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.227967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054920bf-d7fb-48a8-868e-e04dbf9b5262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.241581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054920bf-d7fb-48a8-868e-e04dbf9b5262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.243057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054920bf-d7fb-48a8-868e-e04dbf9b5262 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-054920bf-d7fb-48a8-868e-e04dbf9b5262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:03.259983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:03.261070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:03.261967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:03.261967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:03.261967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:03.261967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:03.261967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 293/586] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:03.261967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054920bf-d7fb-48a8-868e-e04dbf9b5262 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.274015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c93a-78ef-4000-b08e-850e4f363980 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.306789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d39119-7a1f-4322-b7e4-c5fbb777f97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.307734 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d39119-7a1f-4322-b7e4-c5fbb777f97b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.308196 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d39119-7a1f-4322-b7e4-c5fbb777f97b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.308620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d39119-7a1f-4322-b7e4-c5fbb777f97b None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.309508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d39119-7a1f-4322-b7e4-c5fbb777f97b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:03.309970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d39119-7a1f-4322-b7e4-c5fbb777f97b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.311581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d39119-7a1f-4322-b7e4-c5fbb777f97b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.323659 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 294/587] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:03.324923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d39119-7a1f-4322-b7e4-c5fbb777f97b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.363330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054920bf-d7fb-48a8-868e-e04dbf9b5262 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.396643 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82311653-3abc-4225-b6fd-550b6eb0f9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.397506 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311653-3abc-4225-b6fd-550b6eb0f9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.397788 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311653-3abc-4225-b6fd-550b6eb0f9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.398064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311653-3abc-4225-b6fd-550b6eb0f9b1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.405877 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82311653-3abc-4225-b6fd-550b6eb0f9b1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.407397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82311653-3abc-4225-b6fd-550b6eb0f9b1 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-82311653-3abc-4225-b6fd-550b6eb0f9b1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:03.421814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:03.422955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 294/588] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:03.424715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82311653-3abc-4225-b6fd-550b6eb0f9b1 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.430860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d39119-7a1f-4322-b7e4-c5fbb777f97b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.464923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736481c-6aa7-4a4c-8fdc-e86fa277df66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.465603 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736481c-6aa7-4a4c-8fdc-e86fa277df66 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.465883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736481c-6aa7-4a4c-8fdc-e86fa277df66 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.466155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736481c-6aa7-4a4c-8fdc-e86fa277df66 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.466997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736481c-6aa7-4a4c-8fdc-e86fa277df66 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:03.467344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736481c-6aa7-4a4c-8fdc-e86fa277df66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.468786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736481c-6aa7-4a4c-8fdc-e86fa277df66 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.485508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 295/589] 10.222.0.64 () {56 vars in 1137 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:03.486889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736481c-6aa7-4a4c-8fdc-e86fa277df66 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.530678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82311653-3abc-4225-b6fd-550b6eb0f9b1 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.568308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f86af-d706-439f-955b-27318255f5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.568978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f86af-d706-439f-955b-27318255f5bc None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.569271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f86af-d706-439f-955b-27318255f5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.569552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f86af-d706-439f-955b-27318255f5bc None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.570275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f86af-d706-439f-955b-27318255f5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:03.570584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f86af-d706-439f-955b-27318255f5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.572024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f86af-d706-439f-955b-27318255f5bc None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.583739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 295/590] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:03.584545 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f86af-d706-439f-955b-27318255f5bc None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.594870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736481c-6aa7-4a4c-8fdc-e86fa277df66 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.629128 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794eee1-fd2e-412f-ac6e-493fb23df4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.629928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794eee1-fd2e-412f-ac6e-493fb23df4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.630216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794eee1-fd2e-412f-ac6e-493fb23df4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.630499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794eee1-fd2e-412f-ac6e-493fb23df4a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.637035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794eee1-fd2e-412f-ac6e-493fb23df4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.638484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794eee1-fd2e-412f-ac6e-493fb23df4a4 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-f794eee1-fd2e-412f-ac6e-493fb23df4a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:03.652046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:03.652929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:03.653820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:03.653820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:03.653820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:03.653820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:03.653820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:03.653820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:03.653820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:03.653820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:03.653820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 296/591] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:03.654324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794eee1-fd2e-412f-ac6e-493fb23df4a4 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.680758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f86af-d706-439f-955b-27318255f5bc None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.715347 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca16da-a74d-4d03-800c-7fd0311b0038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.716201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca16da-a74d-4d03-800c-7fd0311b0038 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.716555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca16da-a74d-4d03-800c-7fd0311b0038 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.716904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca16da-a74d-4d03-800c-7fd0311b0038 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.717840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca16da-a74d-4d03-800c-7fd0311b0038 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:03.718224 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca16da-a74d-4d03-800c-7fd0311b0038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.719859 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca16da-a74d-4d03-800c-7fd0311b0038 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.744012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 296/592] 10.222.0.64 () {56 vars in 1139 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:03.744012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca16da-a74d-4d03-800c-7fd0311b0038 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.759060 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794eee1-fd2e-412f-ac6e-493fb23df4a4 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.792387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e88510-6dde-4b5f-9cea-3b9e752ef682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.793186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e88510-6dde-4b5f-9cea-3b9e752ef682 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.793472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e88510-6dde-4b5f-9cea-3b9e752ef682 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.793751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e88510-6dde-4b5f-9cea-3b9e752ef682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.804911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e88510-6dde-4b5f-9cea-3b9e752ef682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.806743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e88510-6dde-4b5f-9cea-3b9e752ef682 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-d6e88510-6dde-4b5f-9cea-3b9e752ef682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:03.824258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:03.825239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:03.826115 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:03.826115 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:03.826115 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:03.826115 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:03.830923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 297/593] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:03.831700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e88510-6dde-4b5f-9cea-3b9e752ef682 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.839103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca16da-a74d-4d03-800c-7fd0311b0038 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.873515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35199905-dc8f-4748-96b0-8983e6cd2295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.874308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35199905-dc8f-4748-96b0-8983e6cd2295 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.874590 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35199905-dc8f-4748-96b0-8983e6cd2295 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.874864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35199905-dc8f-4748-96b0-8983e6cd2295 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.881555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35199905-dc8f-4748-96b0-8983e6cd2295 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.883021 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35199905-dc8f-4748-96b0-8983e6cd2295 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-35199905-dc8f-4748-96b0-8983e6cd2295 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:03.896693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:03.897615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:03.898501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:03.898501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:03.898501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:03.898501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:03.898501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:03.898501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:03.898501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:03.898501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:03.898501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 297/594] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:03.898984 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35199905-dc8f-4748-96b0-8983e6cd2295 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.929598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e88510-6dde-4b5f-9cea-3b9e752ef682 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:03.961574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6cfa-f1ab-4abd-b393-b34ce57069d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:03.962242 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6cfa-f1ab-4abd-b393-b34ce57069d6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:03.962519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6cfa-f1ab-4abd-b393-b34ce57069d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:03.962799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6cfa-f1ab-4abd-b393-b34ce57069d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:03.963613 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6cfa-f1ab-4abd-b393-b34ce57069d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:03.963923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6cfa-f1ab-4abd-b393-b34ce57069d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:03.965359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6cfa-f1ab-4abd-b393-b34ce57069d6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:03.977494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 298/595] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:03.978186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6cfa-f1ab-4abd-b393-b34ce57069d6 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:03.998991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35199905-dc8f-4748-96b0-8983e6cd2295 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:04.031519 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e694e87-690f-43e3-8b4b-06c24a346cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:04.032309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e694e87-690f-43e3-8b4b-06c24a346cac None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.032699 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e694e87-690f-43e3-8b4b-06c24a346cac None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.036544 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e694e87-690f-43e3-8b4b-06c24a346cac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.043715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e694e87-690f-43e3-8b4b-06c24a346cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:04.045196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e694e87-690f-43e3-8b4b-06c24a346cac None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-0e694e87-690f-43e3-8b4b-06c24a346cac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:04.061832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:04.062919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:04.064151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:04.064151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:04.064151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:04.064151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:04.064151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 298/596] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:04.064738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbc696-937b-457d-8c82-057f8ed0995d None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.064738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbc696-937b-457d-8c82-057f8ed0995d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.064995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbc696-937b-457d-8c82-057f8ed0995d None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.066299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 299/597] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:04.066995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbc696-937b-457d-8c82-057f8ed0995d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:04.073424 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6cfa-f1ab-4abd-b393-b34ce57069d6 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:04.106148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149125-a128-4cea-a6f9-e64631651668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:04.106803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149125-a128-4cea-a6f9-e64631651668 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.107077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149125-a128-4cea-a6f9-e64631651668 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.107386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149125-a128-4cea-a6f9-e64631651668 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.108096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed149125-a128-4cea-a6f9-e64631651668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:04.108398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed149125-a128-4cea-a6f9-e64631651668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:04.109761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed149125-a128-4cea-a6f9-e64631651668 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:04.120406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 299/598] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:04.121235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149125-a128-4cea-a6f9-e64631651668 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:04.164705 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbc696-937b-457d-8c82-057f8ed0995d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:04.195618 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cae64b-d450-4e8c-89f5-a61b8fa20bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:04.196217 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae64b-d450-4e8c-89f5-a61b8fa20bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.196481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae64b-d450-4e8c-89f5-a61b8fa20bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.196753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae64b-d450-4e8c-89f5-a61b8fa20bd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.197529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cae64b-d450-4e8c-89f5-a61b8fa20bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:04.197833 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cae64b-d450-4e8c-89f5-a61b8fa20bd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:04.199565 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cae64b-d450-4e8c-89f5-a61b8fa20bd7 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:04.211498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 300/599] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:04.212281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cae64b-d450-4e8c-89f5-a61b8fa20bd7 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:04.216618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149125-a128-4cea-a6f9-e64631651668 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:04.248392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a6059-677e-46f7-9bc2-10e0ff63eba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:04.249271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a6059-677e-46f7-9bc2-10e0ff63eba8 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.249555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a6059-677e-46f7-9bc2-10e0ff63eba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.249829 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a6059-677e-46f7-9bc2-10e0ff63eba8 None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/8e00de466abe41da8e6d7dbbd71f5270/roles/7e1ae9fbefc24173bab81ecbd3889e94` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.264961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a6059-677e-46f7-9bc2-10e0ff63eba8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=8e00de466abe41da8e6d7dbbd71f5270, role_id=7e1ae9fbefc24173bab81ecbd3889e94)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:04.266415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a6059-677e-46f7-9bc2-10e0ff63eba8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:04.303927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cae64b-d450-4e8c-89f5-a61b8fa20bd7 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:04.334690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 300/600] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:08:04 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/8e00de466abe41da8e6d7dbbd71f5270/roles/7e1ae9fbefc24173bab81ecbd3889e94 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:08:04.336200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1ac8a-f4a3-4216-ae4c-4b88dfc84ff2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.336311 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648790e3-7c21-425d-934e-e459b7900a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:04.336505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1ac8a-f4a3-4216-ae4c-4b88dfc84ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.336829 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1ac8a-f4a3-4216-ae4c-4b88dfc84ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.336972 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648790e3-7c21-425d-934e-e459b7900a54 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.337189 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648790e3-7c21-425d-934e-e459b7900a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.337462 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648790e3-7c21-425d-934e-e459b7900a54 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.338179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648790e3-7c21-425d-934e-e459b7900a54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:04.338486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648790e3-7c21-425d-934e-e459b7900a54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:04.339926 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648790e3-7c21-425d-934e-e459b7900a54 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:04.353892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 301/601] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:04.354852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648790e3-7c21-425d-934e-e459b7900a54 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:04.358492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a7c1ac8a-f4a3-4216-ae4c-4b88dfc84ff2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:04.358492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a7c1ac8a-f4a3-4216-ae4c-4b88dfc84ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:04.431187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 301/602] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:04.431187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1ac8a-f4a3-4216-ae4c-4b88dfc84ff2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:04.471272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648790e3-7c21-425d-934e-e459b7900a54 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:04.506317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c8eab-000f-47bd-abe2-06ebdef6bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:04.507147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c8eab-000f-47bd-abe2-06ebdef6bf06 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.507438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c8eab-000f-47bd-abe2-06ebdef6bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.507897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c8eab-000f-47bd-abe2-06ebdef6bf06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.516753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c8eab-000f-47bd-abe2-06ebdef6bf06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:04.516753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c8eab-000f-47bd-abe2-06ebdef6bf06 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d72c8eab-000f-47bd-abe2-06ebdef6bf06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:04.533487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:04.534424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:04.535828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:04.535828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:04.535828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:04.535828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:04.535828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:04.535828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:04.535828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:04.535828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:04.536441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1ac8a-f4a3-4216-ae4c-4b88dfc84ff2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:04.536603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 302/603] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:04.540106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c8eab-000f-47bd-abe2-06ebdef6bf06 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:04.567655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e393-972b-45c4-86e6-af9278fab24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:04.568548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e393-972b-45c4-86e6-af9278fab24c None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.568827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e393-972b-45c4-86e6-af9278fab24c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.569099 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e393-972b-45c4-86e6-af9278fab24c None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/efbbecde248c44c7b1d5f3c9522a48a2/roles/7e1ae9fbefc24173bab81ecbd3889e94` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.584448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41e393-972b-45c4-86e6-af9278fab24c None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=efbbecde248c44c7b1d5f3c9522a48a2, role_id=7e1ae9fbefc24173bab81ecbd3889e94)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:04.586014 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41e393-972b-45c4-86e6-af9278fab24c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:04.637603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c8eab-000f-47bd-abe2-06ebdef6bf06 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:04.669832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec8c19-c6ca-48e4-8ec5-f95ab5d13504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:04.670624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec8c19-c6ca-48e4-8ec5-f95ab5d13504 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.670907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec8c19-c6ca-48e4-8ec5-f95ab5d13504 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.671215 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec8c19-c6ca-48e4-8ec5-f95ab5d13504 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.678374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec8c19-c6ca-48e4-8ec5-f95ab5d13504 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:04.679868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec8c19-c6ca-48e4-8ec5-f95ab5d13504 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-e0ec8c19-c6ca-48e4-8ec5-f95ab5d13504 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:04.693491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:04.694553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:04.695777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:04.695777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:04.695777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:04.695777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:04.695777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:04.695777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:04.695777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:04.695777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:04.707436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 302/604] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:08:04 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/efbbecde248c44c7b1d5f3c9522a48a2/roles/7e1ae9fbefc24173bab81ecbd3889e94 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:08:04.707436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e393-972b-45c4-86e6-af9278fab24c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:04.707726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 303/605] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:04.707726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec8c19-c6ca-48e4-8ec5-f95ab5d13504 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:04.810531 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec8c19-c6ca-48e4-8ec5-f95ab5d13504 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:04.817283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e393-972b-45c4-86e6-af9278fab24c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:04.847770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62f1c8-053b-485d-89d7-dc5401905dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:04.848456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62f1c8-053b-485d-89d7-dc5401905dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.848721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62f1c8-053b-485d-89d7-dc5401905dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.849000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62f1c8-053b-485d-89d7-dc5401905dd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.849805 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62f1c8-053b-485d-89d7-dc5401905dd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:04.850117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62f1c8-053b-485d-89d7-dc5401905dd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:04.851669 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62f1c8-053b-485d-89d7-dc5401905dd3 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:04.856635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a58b0-db7c-4527-a31f-a300b8273713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:04.857504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a58b0-db7c-4527-a31f-a300b8273713 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:04.857787 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a58b0-db7c-4527-a31f-a300b8273713 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:04.858058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a58b0-db7c-4527-a31f-a300b8273713 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:04.865285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 304/606] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:04.866235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62f1c8-053b-485d-89d7-dc5401905dd3 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:04.875157 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a58b0-db7c-4527-a31f-a300b8273713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-d20a58b0-db7c-4527-a31f-a300b8273713 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:04.882422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:04.884306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 303/607] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:04.885929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a58b0-db7c-4527-a31f-a300b8273713 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:05.003294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62f1c8-053b-485d-89d7-dc5401905dd3 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:05.015240 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a58b0-db7c-4527-a31f-a300b8273713 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:05.039669 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cce821-a8b4-4f22-9451-cb82b6a63600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:05.040377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cce821-a8b4-4f22-9451-cb82b6a63600 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:05.040619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cce821-a8b4-4f22-9451-cb82b6a63600 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:05.040893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cce821-a8b4-4f22-9451-cb82b6a63600 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:05.041678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cce821-a8b4-4f22-9451-cb82b6a63600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:05.042049 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cce821-a8b4-4f22-9451-cb82b6a63600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:05.043466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cce821-a8b4-4f22-9451-cb82b6a63600 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:05.052110 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283b542-1d79-48ba-8073-e4f1e2a34943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:05.053275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283b542-1d79-48ba-8073-e4f1e2a34943 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:05.053747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283b542-1d79-48ba-8073-e4f1e2a34943 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:05.054216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283b542-1d79-48ba-8073-e4f1e2a34943 None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/cd116be69d7f4cffb770940ccb7514fa/roles/7e1ae9fbefc24173bab81ecbd3889e94` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:05.060130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 305/608] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:05.060130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cce821-a8b4-4f22-9451-cb82b6a63600 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:05.075916 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283b542-1d79-48ba-8073-e4f1e2a34943 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=cd116be69d7f4cffb770940ccb7514fa, role_id=7e1ae9fbefc24173bab81ecbd3889e94)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:05.077842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283b542-1d79-48ba-8073-e4f1e2a34943 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:05.160651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cce821-a8b4-4f22-9451-cb82b6a63600 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:05.178501 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 304/609] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:08:04 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/cd116be69d7f4cffb770940ccb7514fa/roles/7e1ae9fbefc24173bab81ecbd3889e94 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:08:05.179971 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283b542-1d79-48ba-8073-e4f1e2a34943 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:05.231927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf73b45-8825-4d20-9b0e-1aef6ae2a753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:05.233161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf73b45-8825-4d20-9b0e-1aef6ae2a753 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:05.234184 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf73b45-8825-4d20-9b0e-1aef6ae2a753 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:05.236709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf73b45-8825-4d20-9b0e-1aef6ae2a753 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:05.238515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf73b45-8825-4d20-9b0e-1aef6ae2a753 None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:05.239145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf73b45-8825-4d20-9b0e-1aef6ae2a753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:05.241505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf73b45-8825-4d20-9b0e-1aef6ae2a753 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:05.257563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 306/610] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:05.265345 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf73b45-8825-4d20-9b0e-1aef6ae2a753 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:05.383695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283b542-1d79-48ba-8073-e4f1e2a34943 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:05.430941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07da70-9032-43f4-a2c6-f73feb67f0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:05.432202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07da70-9032-43f4-a2c6-f73feb67f0f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:05.432498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07da70-9032-43f4-a2c6-f73feb67f0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:05.433023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07da70-9032-43f4-a2c6-f73feb67f0f5 None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/d99855838f77462886cc87db440e1037/roles/7e1ae9fbefc24173bab81ecbd3889e94` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:05.438552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf73b45-8825-4d20-9b0e-1aef6ae2a753 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:05.449635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07da70-9032-43f4-a2c6-f73feb67f0f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=d99855838f77462886cc87db440e1037, role_id=7e1ae9fbefc24173bab81ecbd3889e94)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:05.451307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07da70-9032-43f4-a2c6-f73feb67f0f5 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:05.475104 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0c4d2-2118-4f95-8ed3-b00abcd41f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:05.476331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0c4d2-2118-4f95-8ed3-b00abcd41f13 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:05.476820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0c4d2-2118-4f95-8ed3-b00abcd41f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:05.477298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0c4d2-2118-4f95-8ed3-b00abcd41f13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:05.490738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0c4d2-2118-4f95-8ed3-b00abcd41f13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:05.492643 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0c4d2-2118-4f95-8ed3-b00abcd41f13 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-34c0c4d2-2118-4f95-8ed3-b00abcd41f13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:05.510961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:05.511910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:05.512816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:05.512816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:05.512816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:05.512816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:05.515339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 307/611] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:05.523269 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0c4d2-2118-4f95-8ed3-b00abcd41f13 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:05.542360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 305/612] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:08:05 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/d99855838f77462886cc87db440e1037/roles/7e1ae9fbefc24173bab81ecbd3889e94 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:08:05.630815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0c4d2-2118-4f95-8ed3-b00abcd41f13 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:05.674671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a59ed-9638-44ac-95f3-07c6484bda80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:05.675290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a59ed-9638-44ac-95f3-07c6484bda80 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:05.675569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a59ed-9638-44ac-95f3-07c6484bda80 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:05.675841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a59ed-9638-44ac-95f3-07c6484bda80 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:05.676561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a59ed-9638-44ac-95f3-07c6484bda80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:05.676865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a59ed-9638-44ac-95f3-07c6484bda80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:05.678267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a59ed-9638-44ac-95f3-07c6484bda80 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:05.695655 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 308/613] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:05.701427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07da70-9032-43f4-a2c6-f73feb67f0f5 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:05.849151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07da70-9032-43f4-a2c6-f73feb67f0f5 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:05.883903 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a798c5-2218-4f47-a029-d78100e95d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:05.884911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a798c5-2218-4f47-a029-d78100e95d5d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:05.885329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a798c5-2218-4f47-a029-d78100e95d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:05.885709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a798c5-2218-4f47-a029-d78100e95d5d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:05.893057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a798c5-2218-4f47-a029-d78100e95d5d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:05.894618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a798c5-2218-4f47-a029-d78100e95d5d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-d8a798c5-2218-4f47-a029-d78100e95d5d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:05.909889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:05.911043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:05.912275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:05.912275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:05.912275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:05.912275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:05.912275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:05.912275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:05.912275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:05.912275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:05.912275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 17:08:05.912275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:05.919148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 306/614] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:05.919422 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a59ed-9638-44ac-95f3-07c6484bda80 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:06.047319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a59ed-9638-44ac-95f3-07c6484bda80 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:06.086401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a431c-c78b-4831-8758-eb11f327d9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:06.087095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a431c-c78b-4831-8758-eb11f327d9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:06.087398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a431c-c78b-4831-8758-eb11f327d9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:06.087670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a431c-c78b-4831-8758-eb11f327d9c5 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:06.088534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a431c-c78b-4831-8758-eb11f327d9c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:06.088842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a431c-c78b-4831-8758-eb11f327d9c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:06.090365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a431c-c78b-4831-8758-eb11f327d9c5 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:06.116223 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 309/615] 10.222.0.64 () {56 vars in 1135 bytes} [Fri May 13 17:08:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:06.121628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a798c5-2218-4f47-a029-d78100e95d5d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:06.240576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a798c5-2218-4f47-a029-d78100e95d5d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:06.282357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a832d-39a6-452b-b46f-f061c7ce06af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:06.283808 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a832d-39a6-452b-b46f-f061c7ce06af None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:06.284195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a832d-39a6-452b-b46f-f061c7ce06af None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:06.284576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a832d-39a6-452b-b46f-f061c7ce06af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:06.295293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a832d-39a6-452b-b46f-f061c7ce06af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:06.296904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a832d-39a6-452b-b46f-f061c7ce06af None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-dc3a832d-39a6-452b-b46f-f061c7ce06af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:06.325921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:06.327032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:06.328145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:06.328145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:06.328145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:06.328145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:06.330529 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 307/616] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:06.336072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a431c-c78b-4831-8758-eb11f327d9c5 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:06.444062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a431c-c78b-4831-8758-eb11f327d9c5 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:06.482138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddacc6d-dbde-45ab-8557-9973526c6b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:06.483042 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacc6d-dbde-45ab-8557-9973526c6b9a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:06.483484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacc6d-dbde-45ab-8557-9973526c6b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:06.483899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacc6d-dbde-45ab-8557-9973526c6b9a None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:06.484776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddacc6d-dbde-45ab-8557-9973526c6b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:06.485223 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddacc6d-dbde-45ab-8557-9973526c6b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:06.487353 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddacc6d-dbde-45ab-8557-9973526c6b9a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:06.503428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 310/617] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:06.505830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a832d-39a6-452b-b46f-f061c7ce06af None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:06.682426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a832d-39a6-452b-b46f-f061c7ce06af None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:06.728692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5968d-2434-4bfd-8fff-e764a5d481d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:06.729862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5968d-2434-4bfd-8fff-e764a5d481d2 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:06.730345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5968d-2434-4bfd-8fff-e764a5d481d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:06.730838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5968d-2434-4bfd-8fff-e764a5d481d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:06.740529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24362a93-fb4c-41c0-8ae3-ce8d22a08086 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:06.741084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24362a93-fb4c-41c0-8ae3-ce8d22a08086 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:06.741558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24362a93-fb4c-41c0-8ae3-ce8d22a08086 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:06.743118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 311/618] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:06.745572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5968d-2434-4bfd-8fff-e764a5d481d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:06.748108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f857ec-d04b-401a-b613-4f59a01ddc79 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:06.748597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f857ec-d04b-401a-b613-4f59a01ddc79 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:06.749076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f857ec-d04b-401a-b613-4f59a01ddc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:06.761240 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5968d-2434-4bfd-8fff-e764a5d481d2 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-e9c5968d-2434-4bfd-8fff-e764a5d481d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:06.780010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:06.780892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:06.781763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:06.781763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:06.781763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:06.781763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:06.781763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:06.781763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:06.781763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:06.781763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:06.784139 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-38f857ec-d04b-401a-b613-4f59a01ddc79 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:06.785549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-38f857ec-d04b-401a-b613-4f59a01ddc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:06.794999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 308/619] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:06.805203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5968d-2434-4bfd-8fff-e764a5d481d2 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:06.905279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 312/620] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:06.938015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5968d-2434-4bfd-8fff-e764a5d481d2 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:06.958297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f857ec-d04b-401a-b613-4f59a01ddc79 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:06.973114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c8e3b-cd84-4d5e-9e0a-d2d0d782a55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:06.973822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c8e3b-cd84-4d5e-9e0a-d2d0d782a55e None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:06.974119 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c8e3b-cd84-4d5e-9e0a-d2d0d782a55e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:06.979170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c8e3b-cd84-4d5e-9e0a-d2d0d782a55e None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:06.979170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c8e3b-cd84-4d5e-9e0a-d2d0d782a55e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:06.979170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c8e3b-cd84-4d5e-9e0a-d2d0d782a55e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:06.979170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c8e3b-cd84-4d5e-9e0a-d2d0d782a55e None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:06.992094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 309/621] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:06.998519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c8e3b-cd84-4d5e-9e0a-d2d0d782a55e None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:07.114548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c8e3b-cd84-4d5e-9e0a-d2d0d782a55e None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:07.159231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c4730-2186-4e8f-b82d-48addceef622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:07.160512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c4730-2186-4e8f-b82d-48addceef622 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:07.160991 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c4730-2186-4e8f-b82d-48addceef622 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:07.161497 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c4730-2186-4e8f-b82d-48addceef622 None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/973cc524d553428aa2b2763ce28cc920/roles/7e1ae9fbefc24173bab81ecbd3889e94` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:07.195815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f857ec-d04b-401a-b613-4f59a01ddc79 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:07.196544 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c4730-2186-4e8f-b82d-48addceef622 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=973cc524d553428aa2b2763ce28cc920, role_id=7e1ae9fbefc24173bab81ecbd3889e94)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:07.198035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c4730-2186-4e8f-b82d-48addceef622 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:07.233420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b5d26-1b90-497d-b2d9-69aa77402edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:07.234604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b5d26-1b90-497d-b2d9-69aa77402edb None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:07.235093 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b5d26-1b90-497d-b2d9-69aa77402edb None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:07.235594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b5d26-1b90-497d-b2d9-69aa77402edb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:07.246367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b5d26-1b90-497d-b2d9-69aa77402edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-a57b5d26-1b90-497d-b2d9-69aa77402edb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:07.254472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:07.255427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:07.256277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:07.259076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 313/622] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:07.268166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b5d26-1b90-497d-b2d9-69aa77402edb None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:07.303287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 310/623] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:08:06 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/973cc524d553428aa2b2763ce28cc920/roles/7e1ae9fbefc24173bab81ecbd3889e94 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:08:07.394543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b5d26-1b90-497d-b2d9-69aa77402edb None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:07.441812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87946080-fd53-4071-b243-c2fa3d2e0ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:07.442869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87946080-fd53-4071-b243-c2fa3d2e0ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:07.443385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87946080-fd53-4071-b243-c2fa3d2e0ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:07.443955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87946080-fd53-4071-b243-c2fa3d2e0ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:07.445022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87946080-fd53-4071-b243-c2fa3d2e0ba9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:07.445541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87946080-fd53-4071-b243-c2fa3d2e0ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:07.447281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87946080-fd53-4071-b243-c2fa3d2e0ba9 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:07.459874 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 314/624] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:07.465667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c4730-2186-4e8f-b82d-48addceef622 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:07.608772 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c4730-2186-4e8f-b82d-48addceef622 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:07.645105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac657fa-bae5-401f-b436-07fa1e1ec858 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:07.645429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac657fa-bae5-401f-b436-07fa1e1ec858 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:07.645680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac657fa-bae5-401f-b436-07fa1e1ec858 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:07.648433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 315/625] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:07.652793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3877d-d973-4c65-ae4a-e3f7d64c5ced None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:07.653001 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3877d-d973-4c65-ae4a-e3f7d64c5ced None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:07.653282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3877d-d973-4c65-ae4a-e3f7d64c5ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:07.654699 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eca4d4-e554-45e8-8304-c5ee28d7fe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:07.655529 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca4d4-e554-45e8-8304-c5ee28d7fe95 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:07.655810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca4d4-e554-45e8-8304-c5ee28d7fe95 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:07.656082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca4d4-e554-45e8-8304-c5ee28d7fe95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:07.672854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eca4d4-e554-45e8-8304-c5ee28d7fe95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:07.675246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eca4d4-e554-45e8-8304-c5ee28d7fe95 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:07.683734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-36a3877d-d973-4c65-ae4a-e3f7d64c5ced None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:07.684966 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-36a3877d-d973-4c65-ae4a-e3f7d64c5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-73eca4d4-e554-45e8-8304-c5ee28d7fe95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:07.694892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:07.695870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:07.696763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:07.696763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:07.696763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:07.696763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:07.696763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 311/626] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:07.703362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eca4d4-e554-45e8-8304-c5ee28d7fe95 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:07.811149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 316/627] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:07.812495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f363-20d8-42d4-bb9a-dd111c93d555 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:07.812784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f363-20d8-42d4-bb9a-dd111c93d555 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:07.813059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f363-20d8-42d4-bb9a-dd111c93d555 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:07.814575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 317/628] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:07.819631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eba3a9-652f-4c90-8307-7d923cdd4aa4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:07.819916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eba3a9-652f-4c90-8307-7d923cdd4aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:07.820194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eba3a9-652f-4c90-8307-7d923cdd4aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:07.837366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d5eba3a9-652f-4c90-8307-7d923cdd4aa4 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:07.838545 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d5eba3a9-652f-4c90-8307-7d923cdd4aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:07.871375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eca4d4-e554-45e8-8304-c5ee28d7fe95 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:07.907299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58548e4-0a08-4041-ae45-cf2186e1b92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:07.907987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58548e4-0a08-4041-ae45-cf2186e1b92f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:07.908270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58548e4-0a08-4041-ae45-cf2186e1b92f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:07.908544 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58548e4-0a08-4041-ae45-cf2186e1b92f None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:07.909268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58548e4-0a08-4041-ae45-cf2186e1b92f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:07.909571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58548e4-0a08-4041-ae45-cf2186e1b92f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:07.910961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58548e4-0a08-4041-ae45-cf2186e1b92f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:07.915258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 318/629] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:08:07.916143 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eba3a9-652f-4c90-8307-7d923cdd4aa4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:07.922808 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 312/630] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:07.928427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58548e4-0a08-4041-ae45-cf2186e1b92f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:08.031281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58548e4-0a08-4041-ae45-cf2186e1b92f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:08.052681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eba3a9-652f-4c90-8307-7d923cdd4aa4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:08.075244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb3181-68e3-457a-bb90-4416ac263ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:08.076209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb3181-68e3-457a-bb90-4416ac263ccc None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.076495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb3181-68e3-457a-bb90-4416ac263ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.077088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb3181-68e3-457a-bb90-4416ac263ccc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.087914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb3181-68e3-457a-bb90-4416ac263ccc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:08.089544 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb3181-68e3-457a-bb90-4416ac263ccc None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:08.090797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056392a-fb0e-430a-879b-d0269bfcd751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:08.091730 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056392a-fb0e-430a-879b-d0269bfcd751 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.092108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056392a-fb0e-430a-879b-d0269bfcd751 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.092483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056392a-fb0e-430a-879b-d0269bfcd751 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.103470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056392a-fb0e-430a-879b-d0269bfcd751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-69eb3181-68e3-457a-bb90-4416ac263ccc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:08.106086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:08.107280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:08.109259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:08.109259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:08.109259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:08.109259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:08.109259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:08.109259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:08.109259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:08.109259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:08.109259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 17:08:08.109259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:08.113135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 313/631] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:08.113135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb3181-68e3-457a-bb90-4416ac263ccc None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d056392a-fb0e-430a-879b-d0269bfcd751 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:08.114228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:08.115152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:08.116031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:08.120250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 319/632] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:08.121187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056392a-fb0e-430a-879b-d0269bfcd751 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:08.230854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056392a-fb0e-430a-879b-d0269bfcd751 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:08.235316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb3181-68e3-457a-bb90-4416ac263ccc None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:08.272325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8eca2-f3af-4559-936c-34bcb05b8478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:08.273016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8eca2-f3af-4559-936c-34bcb05b8478 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.273366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8eca2-f3af-4559-936c-34bcb05b8478 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.273705 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8eca2-f3af-4559-936c-34bcb05b8478 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.274617 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8eca2-f3af-4559-936c-34bcb05b8478 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:08.274990 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8eca2-f3af-4559-936c-34bcb05b8478 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:08.276156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928cf27-43b1-4cd3-8bdb-307418d907fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:08.276609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8eca2-f3af-4559-936c-34bcb05b8478 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:08.277363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cf27-43b1-4cd3-8bdb-307418d907fe None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.277845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cf27-43b1-4cd3-8bdb-307418d907fe None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.278484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cf27-43b1-4cd3-8bdb-307418d907fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.292655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928cf27-43b1-4cd3-8bdb-307418d907fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:08.299229 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 320/633] 10.222.0.64 () {56 vars in 1137 bytes} [Fri May 13 17:08:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:08.299229 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8eca2-f3af-4559-936c-34bcb05b8478 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-d928cf27-43b1-4cd3-8bdb-307418d907fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:08.307293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:08.308263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:08.309193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:08.313182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 314/634] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:08.314057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928cf27-43b1-4cd3-8bdb-307418d907fe None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:08.414289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928cf27-43b1-4cd3-8bdb-307418d907fe None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:08.427959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8eca2-f3af-4559-936c-34bcb05b8478 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:08.446698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdd0d6-ac5a-4bd1-b00b-81f23b0231d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:08.447365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdd0d6-ac5a-4bd1-b00b-81f23b0231d9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.447646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdd0d6-ac5a-4bd1-b00b-81f23b0231d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.447916 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdd0d6-ac5a-4bd1-b00b-81f23b0231d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.463773 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a1ad6-8886-466a-b28a-648559ad305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:08.464700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a1ad6-8886-466a-b28a-648559ad305c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.465191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a1ad6-8886-466a-b28a-648559ad305c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.465658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a1ad6-8886-466a-b28a-648559ad305c None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.466582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a1ad6-8886-466a-b28a-648559ad305c None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:08.467091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a1ad6-8886-466a-b28a-648559ad305c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:08.468681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a1ad6-8886-466a-b28a-648559ad305c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:08.477193 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 321/635] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:08.478097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a1ad6-8886-466a-b28a-648559ad305c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:08.517946 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdd0d6-ac5a-4bd1-b00b-81f23b0231d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:08.519435 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdd0d6-ac5a-4bd1-b00b-81f23b0231d9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:08.574948 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a1ad6-8886-466a-b28a-648559ad305c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:08.607683 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ee6b6-2daa-4fc7-8e04-a711192324ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:08.608356 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ee6b6-2daa-4fc7-8e04-a711192324ff None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.608639 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ee6b6-2daa-4fc7-8e04-a711192324ff None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.608919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ee6b6-2daa-4fc7-8e04-a711192324ff None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.609672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ee6b6-2daa-4fc7-8e04-a711192324ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:08.609981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ee6b6-2daa-4fc7-8e04-a711192324ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:08.615143 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ee6b6-2daa-4fc7-8e04-a711192324ff None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:08.624917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 315/636] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:08:08.624917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12fbad-0cff-4858-a76f-ae916e8790ac None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.624917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12fbad-0cff-4858-a76f-ae916e8790ac None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.624917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12fbad-0cff-4858-a76f-ae916e8790ac None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.624917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 316/637] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:08.624917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12fbad-0cff-4858-a76f-ae916e8790ac None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:08.625443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 322/638] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:08.626617 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70898d5e-ccc6-43f7-b73d-71a6c8219805 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.627159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70898d5e-ccc6-43f7-b73d-71a6c8219805 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.627159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70898d5e-ccc6-43f7-b73d-71a6c8219805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.645564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-70898d5e-ccc6-43f7-b73d-71a6c8219805 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:08.646754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-70898d5e-ccc6-43f7-b73d-71a6c8219805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:08.712244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 323/639] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:08.713421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70898d5e-ccc6-43f7-b73d-71a6c8219805 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:08.740879 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12fbad-0cff-4858-a76f-ae916e8790ac None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:08.773973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5b38b-8219-4803-9b4a-3ecb34818dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:08.774754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5b38b-8219-4803-9b4a-3ecb34818dfb None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.775032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5b38b-8219-4803-9b4a-3ecb34818dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.775338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5b38b-8219-4803-9b4a-3ecb34818dfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.786086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5b38b-8219-4803-9b4a-3ecb34818dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:08.787592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5b38b-8219-4803-9b4a-3ecb34818dfb None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-93d5b38b-8219-4803-9b4a-3ecb34818dfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:08.804731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:08.805644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:08.806513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:08.806513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:08.806513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:08.806513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:08.806513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 317/640] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:08.806801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5b38b-8219-4803-9b4a-3ecb34818dfb None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:08.821857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70898d5e-ccc6-43f7-b73d-71a6c8219805 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:08.855773 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021261ac-6100-4156-ab64-f1a6306c53fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:08.856772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021261ac-6100-4156-ab64-f1a6306c53fa None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.857046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021261ac-6100-4156-ab64-f1a6306c53fa None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.857309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021261ac-6100-4156-ab64-f1a6306c53fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.867430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021261ac-6100-4156-ab64-f1a6306c53fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:08.868880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021261ac-6100-4156-ab64-f1a6306c53fa None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-021261ac-6100-4156-ab64-f1a6306c53fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:08.886185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:08.887087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:08.888061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:08.888061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:08.888061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:08.888061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:08.888061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 324/641] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:08.888333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021261ac-6100-4156-ab64-f1a6306c53fa None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:08.907696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5b38b-8219-4803-9b4a-3ecb34818dfb None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:08.941298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063261b8-8d42-4015-876f-463feb3a918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:08.942076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063261b8-8d42-4015-876f-463feb3a918b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:08.942358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063261b8-8d42-4015-876f-463feb3a918b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:08.942632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063261b8-8d42-4015-876f-463feb3a918b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:08.952343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063261b8-8d42-4015-876f-463feb3a918b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:08.953770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063261b8-8d42-4015-876f-463feb3a918b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-063261b8-8d42-4015-876f-463feb3a918b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:08.974538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:08.975609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:08.976604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:08.976604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:08.976604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:08.976604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:08.976604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 318/642] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:08.976604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063261b8-8d42-4015-876f-463feb3a918b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.001494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021261ac-6100-4156-ab64-f1a6306c53fa None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.045089 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ddf24-62af-459d-8a28-eef7a09c70c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.045901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ddf24-62af-459d-8a28-eef7a09c70c0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.046210 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ddf24-62af-459d-8a28-eef7a09c70c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.046473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ddf24-62af-459d-8a28-eef7a09c70c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.058735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ddf24-62af-459d-8a28-eef7a09c70c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-392ddf24-62af-459d-8a28-eef7a09c70c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:09.066711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:09.067976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 325/643] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:09.073745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ddf24-62af-459d-8a28-eef7a09c70c0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.097684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063261b8-8d42-4015-876f-463feb3a918b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.130713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2917e-82d1-4e9a-b17a-050cf8486a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.131414 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2917e-82d1-4e9a-b17a-050cf8486a67 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.131695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2917e-82d1-4e9a-b17a-050cf8486a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.131980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2917e-82d1-4e9a-b17a-050cf8486a67 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.132701 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2917e-82d1-4e9a-b17a-050cf8486a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:09.133133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2917e-82d1-4e9a-b17a-050cf8486a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.134627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2917e-82d1-4e9a-b17a-050cf8486a67 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:09.146983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 319/644] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:09.148099 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2917e-82d1-4e9a-b17a-050cf8486a67 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.166865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ddf24-62af-459d-8a28-eef7a09c70c0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.200205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa395c-978e-41b1-be32-1189bbe7a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.201101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa395c-978e-41b1-be32-1189bbe7a911 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.201549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa395c-978e-41b1-be32-1189bbe7a911 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.201825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa395c-978e-41b1-be32-1189bbe7a911 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.202550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa395c-978e-41b1-be32-1189bbe7a911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:09.202857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa395c-978e-41b1-be32-1189bbe7a911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.204301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa395c-978e-41b1-be32-1189bbe7a911 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:09.215936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 326/645] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:09.216663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa395c-978e-41b1-be32-1189bbe7a911 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.257018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2917e-82d1-4e9a-b17a-050cf8486a67 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.290537 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaf0ac-067d-450e-a3b9-5726b252d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.291233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaf0ac-067d-450e-a3b9-5726b252d9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.291524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaf0ac-067d-450e-a3b9-5726b252d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.291804 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaf0ac-067d-450e-a3b9-5726b252d9d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.292529 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaaf0ac-067d-450e-a3b9-5726b252d9d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:09.292836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaaf0ac-067d-450e-a3b9-5726b252d9d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.294234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaaf0ac-067d-450e-a3b9-5726b252d9d1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:09.312697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 320/646] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:09.312697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaf0ac-067d-450e-a3b9-5726b252d9d1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.322669 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa395c-978e-41b1-be32-1189bbe7a911 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.356577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc682e04-88a0-449d-be6c-ae05b68d9639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.357244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc682e04-88a0-449d-be6c-ae05b68d9639 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.357525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc682e04-88a0-449d-be6c-ae05b68d9639 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.357797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc682e04-88a0-449d-be6c-ae05b68d9639 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.358539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc682e04-88a0-449d-be6c-ae05b68d9639 None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:09.358843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc682e04-88a0-449d-be6c-ae05b68d9639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.360272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc682e04-88a0-449d-be6c-ae05b68d9639 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:09.368908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 327/647] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:09.373312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc682e04-88a0-449d-be6c-ae05b68d9639 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.409654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaf0ac-067d-450e-a3b9-5726b252d9d1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.444027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c8445-477a-4686-b30c-10f6af8fe90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.444826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c8445-477a-4686-b30c-10f6af8fe90b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.445111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c8445-477a-4686-b30c-10f6af8fe90b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.445390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c8445-477a-4686-b30c-10f6af8fe90b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.452886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c8445-477a-4686-b30c-10f6af8fe90b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.454346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c8445-477a-4686-b30c-10f6af8fe90b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-ca7c8445-477a-4686-b30c-10f6af8fe90b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:09.469126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:09.470160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 321/648] 10.222.0.64 () {56 vars in 1093 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:09.471179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c8445-477a-4686-b30c-10f6af8fe90b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.480764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc682e04-88a0-449d-be6c-ae05b68d9639 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.514119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814c86-3757-40ee-b8a9-1fe215756a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.514914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814c86-3757-40ee-b8a9-1fe215756a1a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.515225 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814c86-3757-40ee-b8a9-1fe215756a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.515499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814c86-3757-40ee-b8a9-1fe215756a1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.522148 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b814c86-3757-40ee-b8a9-1fe215756a1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.523656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b814c86-3757-40ee-b8a9-1fe215756a1a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-0b814c86-3757-40ee-b8a9-1fe215756a1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:09.538609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:09.539584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:09.540983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:09.540983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:09.540983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:09.540983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:09.540983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:09.540983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:09.540983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:09.540983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:09.540983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 328/649] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:09.540983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814c86-3757-40ee-b8a9-1fe215756a1a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.579298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c8445-477a-4686-b30c-10f6af8fe90b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.617321 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030416f-6d57-4c5d-8825-516624ff8947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.618454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030416f-6d57-4c5d-8825-516624ff8947 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.618924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030416f-6d57-4c5d-8825-516624ff8947 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.619441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030416f-6d57-4c5d-8825-516624ff8947 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.627225 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030416f-6d57-4c5d-8825-516624ff8947 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.628687 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030416f-6d57-4c5d-8825-516624ff8947 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-f030416f-6d57-4c5d-8825-516624ff8947 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:09.642987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:09.644074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:09.645010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:09.645010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:09.645010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:09.645010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:09.645010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:09.645010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:09.645010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:09.645010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:09.645010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 17:08:09.645010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:09.645555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814c86-3757-40ee-b8a9-1fe215756a1a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.645639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 322/650] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:09.645639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030416f-6d57-4c5d-8825-516624ff8947 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.681933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a2a8b-c54a-4d29-ab90-11c2c48f3b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.682647 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a2a8b-c54a-4d29-ab90-11c2c48f3b07 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.682929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a2a8b-c54a-4d29-ab90-11c2c48f3b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.683235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a2a8b-c54a-4d29-ab90-11c2c48f3b07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.693156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a2a8b-c54a-4d29-ab90-11c2c48f3b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.694630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a2a8b-c54a-4d29-ab90-11c2c48f3b07 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d36a2a8b-c54a-4d29-ab90-11c2c48f3b07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:09.712556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:09.713511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:09.714423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:09.714423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:09.714423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:09.714423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:09.714423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 329/651] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:09.714709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a2a8b-c54a-4d29-ab90-11c2c48f3b07 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.747892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030416f-6d57-4c5d-8825-516624ff8947 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.780037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf1fdb-c4c9-4e81-9c72-373902f5eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.780702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf1fdb-c4c9-4e81-9c72-373902f5eef9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.780987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf1fdb-c4c9-4e81-9c72-373902f5eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.781265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf1fdb-c4c9-4e81-9c72-373902f5eef9 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.782092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf1fdb-c4c9-4e81-9c72-373902f5eef9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:09.782400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf1fdb-c4c9-4e81-9c72-373902f5eef9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.784402 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf1fdb-c4c9-4e81-9c72-373902f5eef9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:09.801187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 323/652] 10.222.0.64 () {56 vars in 1133 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:09.801980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf1fdb-c4c9-4e81-9c72-373902f5eef9 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.811003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a2a8b-c54a-4d29-ab90-11c2c48f3b07 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.843547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69134611-580d-4719-846b-e156ff08f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.844201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69134611-580d-4719-846b-e156ff08f441 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.844482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69134611-580d-4719-846b-e156ff08f441 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.844755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69134611-580d-4719-846b-e156ff08f441 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.846097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69134611-580d-4719-846b-e156ff08f441 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:09.846404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69134611-580d-4719-846b-e156ff08f441 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.847870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69134611-580d-4719-846b-e156ff08f441 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:09.858806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 330/653] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:09.859616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69134611-580d-4719-846b-e156ff08f441 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.895073 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf1fdb-c4c9-4e81-9c72-373902f5eef9 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.927485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ef42b-f903-4a3f-b671-6290172b7be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.928143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef42b-f903-4a3f-b671-6290172b7be2 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.928427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef42b-f903-4a3f-b671-6290172b7be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.928704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ef42b-f903-4a3f-b671-6290172b7be2 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.929534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ef42b-f903-4a3f-b671-6290172b7be2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:09.929844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ef42b-f903-4a3f-b671-6290172b7be2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.931312 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ef42b-f903-4a3f-b671-6290172b7be2 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:09.948277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 324/654] 10.222.0.64 () {56 vars in 1137 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:09.949683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88763ba0-9403-4fff-9f6a-e35d402b2abc None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.949969 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88763ba0-9403-4fff-9f6a-e35d402b2abc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.950244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88763ba0-9403-4fff-9f6a-e35d402b2abc None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.951663 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 325/655] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:09.952179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88763ba0-9403-4fff-9f6a-e35d402b2abc None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:09.953389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69134611-580d-4719-846b-e156ff08f441 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:09.986347 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31097781-7c02-48cd-b8ef-9e10c362b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:09.987010 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097781-7c02-48cd-b8ef-9e10c362b184 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:09.987327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097781-7c02-48cd-b8ef-9e10c362b184 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:09.987604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097781-7c02-48cd-b8ef-9e10c362b184 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:09.988322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31097781-7c02-48cd-b8ef-9e10c362b184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:09.988697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31097781-7c02-48cd-b8ef-9e10c362b184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:09.990020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31097781-7c02-48cd-b8ef-9e10c362b184 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:10.005704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 331/656] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:10.005704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31097781-7c02-48cd-b8ef-9e10c362b184 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:10.050087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88763ba0-9403-4fff-9f6a-e35d402b2abc None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:10.081776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f6bee-5708-4ed6-a1f3-09d5b297dd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:10.082405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6bee-5708-4ed6-a1f3-09d5b297dd64 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:10.082687 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6bee-5708-4ed6-a1f3-09d5b297dd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:10.082959 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6bee-5708-4ed6-a1f3-09d5b297dd64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:10.099669 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31097781-7c02-48cd-b8ef-9e10c362b184 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:10.131100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e84d28-2c0c-44c3-8015-976eb3ac5d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:10.131770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e84d28-2c0c-44c3-8015-976eb3ac5d54 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:10.132052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e84d28-2c0c-44c3-8015-976eb3ac5d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:10.132329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e84d28-2c0c-44c3-8015-976eb3ac5d54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:10.133144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e84d28-2c0c-44c3-8015-976eb3ac5d54 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=8e00de466abe41da8e6d7dbbd71f5270) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:10.133453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e84d28-2c0c-44c3-8015-976eb3ac5d54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:10.134906 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e84d28-2c0c-44c3-8015-976eb3ac5d54 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:10.140662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 332/657] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:10 2022] GET /identity/v3/role_assignments?user.id=8e00de466abe41da8e6d7dbbd71f5270&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:10.141222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e84d28-2c0c-44c3-8015-976eb3ac5d54 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:10.145400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f6bee-5708-4ed6-a1f3-09d5b297dd64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:10.146877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f6bee-5708-4ed6-a1f3-09d5b297dd64 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:10.246973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e84d28-2c0c-44c3-8015-976eb3ac5d54 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:10.255461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 326/658] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:08:10.255461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b570cc1-4547-46ca-bb0f-2814092729c2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:10.255461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b570cc1-4547-46ca-bb0f-2814092729c2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:10.255461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b570cc1-4547-46ca-bb0f-2814092729c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:10.269972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-9b570cc1-4547-46ca-bb0f-2814092729c2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:10.271346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-9b570cc1-4547-46ca-bb0f-2814092729c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:10.285187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d335a4-4ea9-4d58-8927-25305c9441f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:10.285843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d335a4-4ea9-4d58-8927-25305c9441f0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:10.286120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d335a4-4ea9-4d58-8927-25305c9441f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:10.286388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d335a4-4ea9-4d58-8927-25305c9441f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:10.347708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 327/659] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:10.348871 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b570cc1-4547-46ca-bb0f-2814092729c2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:10.388216 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d335a4-4ea9-4d58-8927-25305c9441f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:10.390720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d335a4-4ea9-4d58-8927-25305c9441f0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:10.456588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b570cc1-4547-46ca-bb0f-2814092729c2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:10.490405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ccc09-5263-4a02-9260-2cd533522a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:10.491240 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ccc09-5263-4a02-9260-2cd533522a17 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:10.491525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ccc09-5263-4a02-9260-2cd533522a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:10.491801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ccc09-5263-4a02-9260-2cd533522a17 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:10.501174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 333/660] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:08:10.501174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d335a4-4ea9-4d58-8927-25305c9441f0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:10.502669 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ccc09-5263-4a02-9260-2cd533522a17 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:10.504168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ccc09-5263-4a02-9260-2cd533522a17 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-862ccc09-5263-4a02-9260-2cd533522a17 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:10.519067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:10.520140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:10.521092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:10.521092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:10.521092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:10.521092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:10.521092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:10.521092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:10.521092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:10.521092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:10.521092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 17:08:10.521092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:10.521092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 328/661] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:10.521692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ccc09-5263-4a02-9260-2cd533522a17 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:10.598869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d335a4-4ea9-4d58-8927-25305c9441f0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:10.619980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ccc09-5263-4a02-9260-2cd533522a17 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:10.634542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db3ce-f331-434e-a605-d607c22ec962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:10.635375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db3ce-f331-434e-a605-d607c22ec962 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:10.635659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db3ce-f331-434e-a605-d607c22ec962 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:10.635937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db3ce-f331-434e-a605-d607c22ec962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:10.645930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69db3ce-f331-434e-a605-d607c22ec962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:10.647728 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69db3ce-f331-434e-a605-d607c22ec962 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:10.654866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a31e19-daea-4a09-a2f1-39d5dfc7054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:10.656052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a31e19-daea-4a09-a2f1-39d5dfc7054e None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:10.656052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a31e19-daea-4a09-a2f1-39d5dfc7054e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:10.656229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a31e19-daea-4a09-a2f1-39d5dfc7054e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-e69db3ce-f331-434e-a605-d607c22ec962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:10.665424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:10.666295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:10.667208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:10.667208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:10.667208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:10.667208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:10.671252 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 334/662] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:10.671957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db3ce-f331-434e-a605-d607c22ec962 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:10.677436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a31e19-daea-4a09-a2f1-39d5dfc7054e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-a5a31e19-daea-4a09-a2f1-39d5dfc7054e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:10.685528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:10.686499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:10.687411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:10.691480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 329/663] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:10.692640 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a31e19-daea-4a09-a2f1-39d5dfc7054e None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:10.772664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db3ce-f331-434e-a605-d607c22ec962 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:10.800676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a31e19-daea-4a09-a2f1-39d5dfc7054e None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:10.805856 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39f221-1d51-4349-b1b7-7e42fd6a1955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:10.806654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39f221-1d51-4349-b1b7-7e42fd6a1955 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:10.806937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39f221-1d51-4349-b1b7-7e42fd6a1955 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:10.807238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39f221-1d51-4349-b1b7-7e42fd6a1955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:10.817212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39f221-1d51-4349-b1b7-7e42fd6a1955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:10.818703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39f221-1d51-4349-b1b7-7e42fd6a1955 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:10.833147 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05534-2ba1-4d91-b63c-f277c504dd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:10.833806 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05534-2ba1-4d91-b63c-f277c504dd65 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:10.834091 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05534-2ba1-4d91-b63c-f277c504dd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:10.834364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05534-2ba1-4d91-b63c-f277c504dd65 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:10.835215 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc05534-2ba1-4d91-b63c-f277c504dd65 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:10.835524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc05534-2ba1-4d91-b63c-f277c504dd65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-ec39f221-1d51-4349-b1b7-7e42fd6a1955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:10.836577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:10.837420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:10.838351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:10.838351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:10.838351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:10.838351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:10.838570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc05534-2ba1-4d91-b63c-f277c504dd65 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:10.842337 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 335/664] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:10.843099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39f221-1d51-4349-b1b7-7e42fd6a1955 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:10.858813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 330/665] 10.222.0.64 () {56 vars in 1139 bytes} [Fri May 13 17:08:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:10.858813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05534-2ba1-4d91-b63c-f277c504dd65 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:10.939928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39f221-1d51-4349-b1b7-7e42fd6a1955 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:10.953813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05534-2ba1-4d91-b63c-f277c504dd65 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:10.973497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd010b-71ad-4bea-b621-71d2eb9f18c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:10.974163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd010b-71ad-4bea-b621-71d2eb9f18c8 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:10.974446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd010b-71ad-4bea-b621-71d2eb9f18c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:10.974722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd010b-71ad-4bea-b621-71d2eb9f18c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:10.975476 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd010b-71ad-4bea-b621-71d2eb9f18c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:10.975786 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd010b-71ad-4bea-b621-71d2eb9f18c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:10.977208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd010b-71ad-4bea-b621-71d2eb9f18c8 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:10.987856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599519e1-73ce-4533-a3a8-11ea6121ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:10.993748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599519e1-73ce-4533-a3a8-11ea6121ff97 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:10.993748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599519e1-73ce-4533-a3a8-11ea6121ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.002804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 336/666] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:11.003518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599519e1-73ce-4533-a3a8-11ea6121ff97 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.003609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd010b-71ad-4bea-b621-71d2eb9f18c8 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.003695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599519e1-73ce-4533-a3a8-11ea6121ff97 None admin] RBAC: Adding query filter params (name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:11.003695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599519e1-73ce-4533-a3a8-11ea6121ff97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.003695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599519e1-73ce-4533-a3a8-11ea6121ff97 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.003695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 331/667] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:11.003695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599519e1-73ce-4533-a3a8-11ea6121ff97 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.112166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd010b-71ad-4bea-b621-71d2eb9f18c8 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:11.112694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599519e1-73ce-4533-a3a8-11ea6121ff97 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:11.144328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46840c1f-429a-4218-9543-b19eb2a45f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:11.145020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46840c1f-429a-4218-9543-b19eb2a45f88 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:11.145302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46840c1f-429a-4218-9543-b19eb2a45f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.145582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46840c1f-429a-4218-9543-b19eb2a45f88 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.146295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46840c1f-429a-4218-9543-b19eb2a45f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:11.146600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46840c1f-429a-4218-9543-b19eb2a45f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.147848 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f67cfc-fd75-40a2-b648-42625f2e5f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:11.148294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46840c1f-429a-4218-9543-b19eb2a45f88 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.148668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f67cfc-fd75-40a2-b648-42625f2e5f8c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:11.149057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f67cfc-fd75-40a2-b648-42625f2e5f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.149427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f67cfc-fd75-40a2-b648-42625f2e5f8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.164399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 337/668] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:11.164399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46840c1f-429a-4218-9543-b19eb2a45f88 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.216653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f67cfc-fd75-40a2-b648-42625f2e5f8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.218192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f67cfc-fd75-40a2-b648-42625f2e5f8c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.259315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46840c1f-429a-4218-9543-b19eb2a45f88 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:11.291731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a147a4-9c58-4a5b-b1ad-e798497878bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:11.292524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a147a4-9c58-4a5b-b1ad-e798497878bd None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:11.292798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a147a4-9c58-4a5b-b1ad-e798497878bd None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.293068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a147a4-9c58-4a5b-b1ad-e798497878bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.300381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a147a4-9c58-4a5b-b1ad-e798497878bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.301824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a147a4-9c58-4a5b-b1ad-e798497878bd None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.318344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 332/669] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:08:11.318344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f67cfc-fd75-40a2-b648-42625f2e5f8c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d9a147a4-9c58-4a5b-b1ad-e798497878bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:11.318579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:11.319465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:11.320458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:11.320458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:11.320458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:11.320458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:11.320458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:11.320458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:11.320458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:11.320458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:11.320458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 338/670] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:11.320458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a147a4-9c58-4a5b-b1ad-e798497878bd None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.422424 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f67cfc-fd75-40a2-b648-42625f2e5f8c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:11.429326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a147a4-9c58-4a5b-b1ad-e798497878bd None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:11.456860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087b65a-d5ce-49fd-b79d-8b436d410cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:11.457646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b65a-d5ce-49fd-b79d-8b436d410cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:11.457927 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b65a-d5ce-49fd-b79d-8b436d410cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.458203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b65a-d5ce-49fd-b79d-8b436d410cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.462140 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269d6bc-cf33-45cb-b2b5-100d2bcf8598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:11.462997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269d6bc-cf33-45cb-b2b5-100d2bcf8598 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:11.463372 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269d6bc-cf33-45cb-b2b5-100d2bcf8598 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.463714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269d6bc-cf33-45cb-b2b5-100d2bcf8598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.468301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087b65a-d5ce-49fd-b79d-8b436d410cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.469770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087b65a-d5ce-49fd-b79d-8b436d410cc0 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.471253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269d6bc-cf33-45cb-b2b5-100d2bcf8598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.472825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269d6bc-cf33-45cb-b2b5-100d2bcf8598 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-c269d6bc-cf33-45cb-b2b5-100d2bcf8598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:11.487763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:11.488846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:11.490176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:11.490176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:11.490176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:11.490176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:11.490176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:11.490176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:11.490176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:11.490176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-3087b65a-d5ce-49fd-b79d-8b436d410cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:11.490724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:11.497038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:11.498291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:11.498291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:11.498291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:11.498291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:11.498291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 333/671] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:11.498291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087b65a-d5ce-49fd-b79d-8b436d410cc0 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.499290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 339/672] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:11.499290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269d6bc-cf33-45cb-b2b5-100d2bcf8598 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.591747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087b65a-d5ce-49fd-b79d-8b436d410cc0 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:11.592400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269d6bc-cf33-45cb-b2b5-100d2bcf8598 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:11.625374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5264082-f64e-4cf8-8a12-82e4fb2d7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:11.626158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5264082-f64e-4cf8-8a12-82e4fb2d7d1f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:11.626452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5264082-f64e-4cf8-8a12-82e4fb2d7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.626733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5264082-f64e-4cf8-8a12-82e4fb2d7d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.627305 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2d10-8d83-4f39-b047-79130eaae6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:11.627963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2d10-8d83-4f39-b047-79130eaae6fd None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:11.628246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2d10-8d83-4f39-b047-79130eaae6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.628533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2d10-8d83-4f39-b047-79130eaae6fd None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.629322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb2d10-8d83-4f39-b047-79130eaae6fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:11.629619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb2d10-8d83-4f39-b047-79130eaae6fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.631106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb2d10-8d83-4f39-b047-79130eaae6fd None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.638537 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5264082-f64e-4cf8-8a12-82e4fb2d7d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.640019 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5264082-f64e-4cf8-8a12-82e4fb2d7d1f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.643713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 340/673] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:11.644655 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2d10-8d83-4f39-b047-79130eaae6fd None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-d5264082-f64e-4cf8-8a12-82e4fb2d7d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:11.658612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:11.659626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:11.660512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:11.660512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:11.660512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:11.660512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:11.660512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 334/674] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:11.661127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5264082-f64e-4cf8-8a12-82e4fb2d7d1f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.756428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2d10-8d83-4f39-b047-79130eaae6fd None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:11.762216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5264082-f64e-4cf8-8a12-82e4fb2d7d1f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:11.791423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d913d2d-42a8-4e9f-a2a0-b1913e5de7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:11.792232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d913d2d-42a8-4e9f-a2a0-b1913e5de7ca None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:11.792345 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d913d2d-42a8-4e9f-a2a0-b1913e5de7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.792614 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d913d2d-42a8-4e9f-a2a0-b1913e5de7ca None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.793429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d913d2d-42a8-4e9f-a2a0-b1913e5de7ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:11.793685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d913d2d-42a8-4e9f-a2a0-b1913e5de7ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.795197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d913d2d-42a8-4e9f-a2a0-b1913e5de7ca None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.798744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ab55b-8cbd-4594-a168-f5759f296240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:11.799699 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab55b-8cbd-4594-a168-f5759f296240 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:11.800196 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab55b-8cbd-4594-a168-f5759f296240 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.800676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab55b-8cbd-4594-a168-f5759f296240 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.801616 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ab55b-8cbd-4594-a168-f5759f296240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:11.802126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ab55b-8cbd-4594-a168-f5759f296240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.804229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ab55b-8cbd-4594-a168-f5759f296240 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.807630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 341/675] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:11.808524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d913d2d-42a8-4e9f-a2a0-b1913e5de7ca None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.822139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 335/676] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:11.823343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ab55b-8cbd-4594-a168-f5759f296240 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.913063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d913d2d-42a8-4e9f-a2a0-b1913e5de7ca None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:11.921065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ab55b-8cbd-4594-a168-f5759f296240 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:11.947253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264f250-0a75-487c-b986-1258478f1aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:11.947909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264f250-0a75-487c-b986-1258478f1aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:11.948210 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264f250-0a75-487c-b986-1258478f1aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.948461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264f250-0a75-487c-b986-1258478f1aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.949542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264f250-0a75-487c-b986-1258478f1aa8 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=efbbecde248c44c7b1d5f3c9522a48a2) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:11.949852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264f250-0a75-487c-b986-1258478f1aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.951325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264f250-0a75-487c-b986-1258478f1aa8 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.956321 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97a4bf-7b12-441f-a0fa-fab67fbea891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:11.957243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97a4bf-7b12-441f-a0fa-fab67fbea891 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:11.957715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97a4bf-7b12-441f-a0fa-fab67fbea891 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:11.958147 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97a4bf-7b12-441f-a0fa-fab67fbea891 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:11.959040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97a4bf-7b12-441f-a0fa-fab67fbea891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:11.959525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97a4bf-7b12-441f-a0fa-fab67fbea891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:11.960034 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 342/677] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/role_assignments?user.id=efbbecde248c44c7b1d5f3c9522a48a2&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:11.960837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264f250-0a75-487c-b986-1258478f1aa8 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:11.961580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97a4bf-7b12-441f-a0fa-fab67fbea891 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:11.989181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 336/678] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:11.989181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97a4bf-7b12-441f-a0fa-fab67fbea891 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:12.094921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97a4bf-7b12-441f-a0fa-fab67fbea891 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:12.104918 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264f250-0a75-487c-b986-1258478f1aa8 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:12.131876 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ab4bc-2057-4c25-a4c5-c6496530cded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:12.132685 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ab4bc-2057-4c25-a4c5-c6496530cded None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:12.133352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ab4bc-2057-4c25-a4c5-c6496530cded None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:12.133352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ab4bc-2057-4c25-a4c5-c6496530cded None admin] PATH_INFO: `/v3/users/swift` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:12.142268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ab4bc-2057-4c25-a4c5-c6496530cded None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:12.143842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ab4bc-2057-4c25-a4c5-c6496530cded None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:12.151533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957c752-7cab-4577-8506-c9c5a8710859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:12.153120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957c752-7cab-4577-8506-c9c5a8710859 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:12.153558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957c752-7cab-4577-8506-c9c5a8710859 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:12.153975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957c752-7cab-4577-8506-c9c5a8710859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:12.154965 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957c752-7cab-4577-8506-c9c5a8710859 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=cd116be69d7f4cffb770940ccb7514fa) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:12.155449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957c752-7cab-4577-8506-c9c5a8710859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:12.157091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957c752-7cab-4577-8506-c9c5a8710859 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-fd3ab4bc-2057-4c25-a4c5-c6496530cded None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:12.161490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:12.162942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:12.164136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:12.164136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:12.164136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:12.164136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:12.164136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:12.164136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:12.164136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:12.164136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:12.164136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 17:08:12.164136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:12.167519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 337/679] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:12.168588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ab4bc-2057-4c25-a4c5-c6496530cded None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:12.168830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 343/680] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:11 2022] GET /identity/v3/role_assignments?user.id=cd116be69d7f4cffb770940ccb7514fa&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:12.169847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957c752-7cab-4577-8506-c9c5a8710859 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:12.290803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ab4bc-2057-4c25-a4c5-c6496530cded None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:12.307558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957c752-7cab-4577-8506-c9c5a8710859 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:12.328820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac38d2b-a96f-4376-940f-461b346728d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:12.330180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac38d2b-a96f-4376-940f-461b346728d6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:12.330661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac38d2b-a96f-4376-940f-461b346728d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:12.330967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac38d2b-a96f-4376-940f-461b346728d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:12.339270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac38d2b-a96f-4376-940f-461b346728d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:12.340841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac38d2b-a96f-4376-940f-461b346728d6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:12.352576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a65110-d1d0-4149-8753-0fc3f55f2903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:12.353607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65110-d1d0-4149-8753-0fc3f55f2903 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:12.354088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65110-d1d0-4149-8753-0fc3f55f2903 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:12.354562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65110-d1d0-4149-8753-0fc3f55f2903 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:12.355670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a65110-d1d0-4149-8753-0fc3f55f2903 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:12.356225 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a65110-d1d0-4149-8753-0fc3f55f2903 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-1ac38d2b-a96f-4376-940f-461b346728d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:12.357670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:12.358522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:12.359423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:12.359423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:12.359423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:12.359423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:12.359423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:12.359423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:12.359423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:12.359423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:12.360611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a65110-d1d0-4149-8753-0fc3f55f2903 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:12.363324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 338/681] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:12.365735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac38d2b-a96f-4376-940f-461b346728d6 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:12.384113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 344/682] 10.222.0.64 () {56 vars in 1135 bytes} [Fri May 13 17:08:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:12.390081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a65110-d1d0-4149-8753-0fc3f55f2903 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:12.496921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac38d2b-a96f-4376-940f-461b346728d6 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:12.508655 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a65110-d1d0-4149-8753-0fc3f55f2903 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:12.534399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d06386-0c9f-4b1e-9e3a-e6a3029d5c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:12.535120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d06386-0c9f-4b1e-9e3a-e6a3029d5c1f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:12.535430 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d06386-0c9f-4b1e-9e3a-e6a3029d5c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:12.535712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d06386-0c9f-4b1e-9e3a-e6a3029d5c1f None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:12.536507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d06386-0c9f-4b1e-9e3a-e6a3029d5c1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:12.536821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d06386-0c9f-4b1e-9e3a-e6a3029d5c1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:12.538270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d06386-0c9f-4b1e-9e3a-e6a3029d5c1f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:12.542472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcf710-b553-4bbe-8913-e9ca175f6f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:12.543142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcf710-b553-4bbe-8913-e9ca175f6f02 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:12.543425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcf710-b553-4bbe-8913-e9ca175f6f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:12.543701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcf710-b553-4bbe-8913-e9ca175f6f02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:12.556269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 339/683] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:12.557676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accaf65e-8f6b-4eb5-b211-f6069d99663e None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:12.557970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accaf65e-8f6b-4eb5-b211-f6069d99663e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:12.558253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accaf65e-8f6b-4eb5-b211-f6069d99663e None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:12.559887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 340/684] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:12.561133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accaf65e-8f6b-4eb5-b211-f6069d99663e None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:12.611850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcf710-b553-4bbe-8913-e9ca175f6f02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:12.613322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcf710-b553-4bbe-8913-e9ca175f6f02 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:12.665920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accaf65e-8f6b-4eb5-b211-f6069d99663e None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:12.701757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f77f94-e34b-4ea2-b0c8-f7367a194332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:12.702419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77f94-e34b-4ea2-b0c8-f7367a194332 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:12.702704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77f94-e34b-4ea2-b0c8-f7367a194332 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:12.702979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77f94-e34b-4ea2-b0c8-f7367a194332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:12.703845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f77f94-e34b-4ea2-b0c8-f7367a194332 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=d99855838f77462886cc87db440e1037) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:12.704154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f77f94-e34b-4ea2-b0c8-f7367a194332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:12.705652 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f77f94-e34b-4ea2-b0c8-f7367a194332 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:12.717245 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 341/686] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:12 2022] GET /identity/v3/role_assignments?user.id=d99855838f77462886cc87db440e1037&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:12.717455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 345/686] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:08:12.718407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcf710-b553-4bbe-8913-e9ca175f6f02 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:12.718851 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f8aea-8c10-4cbb-9e97-1c0ca4254671 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:12.719165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f8aea-8c10-4cbb-9e97-1c0ca4254671 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:12.719453 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f8aea-8c10-4cbb-9e97-1c0ca4254671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:12.743918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-8e0f8aea-8c10-4cbb-9e97-1c0ca4254671 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:12.745152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8e0f8aea-8c10-4cbb-9e97-1c0ca4254671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:12.874878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcf710-b553-4bbe-8913-e9ca175f6f02 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:12.877028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 342/687] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:12.907037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f8aea-8c10-4cbb-9e97-1c0ca4254671 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:12.924718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3be41-9ba1-45db-81f1-f5ca12ce4391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:12.925886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3be41-9ba1-45db-81f1-f5ca12ce4391 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:12.927875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3be41-9ba1-45db-81f1-f5ca12ce4391 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:12.928322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3be41-9ba1-45db-81f1-f5ca12ce4391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:12.941538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3be41-9ba1-45db-81f1-f5ca12ce4391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:12.943340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3be41-9ba1-45db-81f1-f5ca12ce4391 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-f5b3be41-9ba1-45db-81f1-f5ca12ce4391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:12.961866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:12.962981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:12.964075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:12.964075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:12.964075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:12.964075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:12.965594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 346/688] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:12.971623 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3be41-9ba1-45db-81f1-f5ca12ce4391 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:13.045264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f8aea-8c10-4cbb-9e97-1c0ca4254671 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:13.079077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3be41-9ba1-45db-81f1-f5ca12ce4391 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:13.086923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c89474-93f1-4859-b34f-2bcccff7df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:13.087242 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89474-93f1-4859-b34f-2bcccff7df85 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:13.087622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89474-93f1-4859-b34f-2bcccff7df85 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:13.087899 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89474-93f1-4859-b34f-2bcccff7df85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:13.098754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c89474-93f1-4859-b34f-2bcccff7df85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:13.100271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c89474-93f1-4859-b34f-2bcccff7df85 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:13.119029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b051a-04b0-4d8a-bc32-0b220d4d6c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:13.120097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b051a-04b0-4d8a-bc32-0b220d4d6c94 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:13.120568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b051a-04b0-4d8a-bc32-0b220d4d6c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:13.121032 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b051a-04b0-4d8a-bc32-0b220d4d6c94 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:13.121929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b051a-04b0-4d8a-bc32-0b220d4d6c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:13.122419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b051a-04b0-4d8a-bc32-0b220d4d6c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-58c89474-93f1-4859-b34f-2bcccff7df85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:13.123311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:13.124176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:13.125122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:13.125122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:13.125122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:13.125122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:13.125122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 343/689] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:13.126383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b051a-04b0-4d8a-bc32-0b220d4d6c94 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:13.131102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c89474-93f1-4859-b34f-2bcccff7df85 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:13.139819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 347/690] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:13.148157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b051a-04b0-4d8a-bc32-0b220d4d6c94 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:13.245261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c89474-93f1-4859-b34f-2bcccff7df85 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:13.255115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b051a-04b0-4d8a-bc32-0b220d4d6c94 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:13.278921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bd649-70f9-4b12-aceb-718c8b9980ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:13.279614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bd649-70f9-4b12-aceb-718c8b9980ad None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:13.279895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bd649-70f9-4b12-aceb-718c8b9980ad None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:13.280168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bd649-70f9-4b12-aceb-718c8b9980ad None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:13.280880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bd649-70f9-4b12-aceb-718c8b9980ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:13.281178 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bd649-70f9-4b12-aceb-718c8b9980ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:13.282672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bd649-70f9-4b12-aceb-718c8b9980ad None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:13.289070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3920a1-d0ff-4053-ae2d-b5dd688ca96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:13.289870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3920a1-d0ff-4053-ae2d-b5dd688ca96c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:13.290150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3920a1-d0ff-4053-ae2d-b5dd688ca96c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:13.290424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3920a1-d0ff-4053-ae2d-b5dd688ca96c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:13.294571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 344/691] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:13.297582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3920a1-d0ff-4053-ae2d-b5dd688ca96c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:13.299645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3920a1-d0ff-4053-ae2d-b5dd688ca96c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:13.301125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bd649-70f9-4b12-aceb-718c8b9980ad None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-7d3920a1-d0ff-4053-ae2d-b5dd688ca96c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:13.314908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:13.315883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:13.316772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:13.316772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:13.316772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:13.316772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:13.316772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:13.316772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:13.316772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:13.316772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:13.316772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 348/692] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:13.324039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3920a1-d0ff-4053-ae2d-b5dd688ca96c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:13.473044 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3920a1-d0ff-4053-ae2d-b5dd688ca96c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:13.477379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bd649-70f9-4b12-aceb-718c8b9980ad None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:13.509171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc53509-097a-4bc8-a9d2-2084c76a02e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:13.509886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc53509-097a-4bc8-a9d2-2084c76a02e0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:13.510164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc53509-097a-4bc8-a9d2-2084c76a02e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:13.510433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc53509-097a-4bc8-a9d2-2084c76a02e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:13.511316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc53509-097a-4bc8-a9d2-2084c76a02e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:13.511620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc53509-097a-4bc8-a9d2-2084c76a02e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:13.513063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc53509-097a-4bc8-a9d2-2084c76a02e0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:13.514388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da41fd-1937-4b38-bebc-a329bd682a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:13.515068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da41fd-1937-4b38-bebc-a329bd682a39 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:13.515378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da41fd-1937-4b38-bebc-a329bd682a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:13.515657 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da41fd-1937-4b38-bebc-a329bd682a39 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:13.516371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da41fd-1937-4b38-bebc-a329bd682a39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:13.517881 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da41fd-1937-4b38-bebc-a329bd682a39 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:13.525574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 349/693] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:13.531742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc53509-097a-4bc8-a9d2-2084c76a02e0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:13.635717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 345/694] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:08:13 2022] POST /identity/v3/users => generated 254 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:13.640399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc53509-097a-4bc8-a9d2-2084c76a02e0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:13.680013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837168f-fa06-4c3c-a077-d648e515c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:13.680691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837168f-fa06-4c3c-a077-d648e515c869 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:13.680968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837168f-fa06-4c3c-a077-d648e515c869 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:13.681237 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837168f-fa06-4c3c-a077-d648e515c869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:13.682134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837168f-fa06-4c3c-a077-d648e515c869 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=973cc524d553428aa2b2763ce28cc920) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:13.682446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837168f-fa06-4c3c-a077-d648e515c869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:13.683975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837168f-fa06-4c3c-a077-d648e515c869 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:13.691151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 350/695] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:13 2022] GET /identity/v3/role_assignments?user.id=973cc524d553428aa2b2763ce28cc920&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:14.800169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7061e59-6655-4afa-ae28-4df52ed03582 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:14.800169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7061e59-6655-4afa-ae28-4df52ed03582 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:14.800169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7061e59-6655-4afa-ae28-4df52ed03582 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:14.800169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 346/696] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:14.806483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e57c5-4756-4e2f-82dc-bbd7377a26dc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:14.806947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e57c5-4756-4e2f-82dc-bbd7377a26dc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:14.807112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e57c5-4756-4e2f-82dc-bbd7377a26dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:14.826962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ab5e57c5-4756-4e2f-82dc-bbd7377a26dc None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:14.828175 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ab5e57c5-4756-4e2f-82dc-bbd7377a26dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:14.902252 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17da19b-651b-46d6-8a89-472c69455323 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:14.902911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17da19b-651b-46d6-8a89-472c69455323 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:14.903329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17da19b-651b-46d6-8a89-472c69455323 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:14.905852 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 347/697] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:14.910179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7145cb7-ac08-4d3f-a4bc-8615ec95ee32 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:14.910469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7145cb7-ac08-4d3f-a4bc-8615ec95ee32 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:14.910752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7145cb7-ac08-4d3f-a4bc-8615ec95ee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:14.927893 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f7145cb7-ac08-4d3f-a4bc-8615ec95ee32 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:14.929427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f7145cb7-ac08-4d3f-a4bc-8615ec95ee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:14.929540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 351/698] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:14.973031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e57c5-4756-4e2f-82dc-bbd7377a26dc None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:14.998428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 348/699] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:08:15.037626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7145cb7-ac08-4d3f-a4bc-8615ec95ee32 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:15.171718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e57c5-4756-4e2f-82dc-bbd7377a26dc None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:15.223966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7145cb7-ac08-4d3f-a4bc-8615ec95ee32 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:15.228242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525577c6-8ade-49ff-97a3-53a4acdf37f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:15.229047 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525577c6-8ade-49ff-97a3-53a4acdf37f2 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:15.229327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525577c6-8ade-49ff-97a3-53a4acdf37f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:15.229600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525577c6-8ade-49ff-97a3-53a4acdf37f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:15.249100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525577c6-8ade-49ff-97a3-53a4acdf37f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-525577c6-8ade-49ff-97a3-53a4acdf37f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:15.256842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:15.257776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:15.258621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:15.260830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 352/700] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:15.268309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525577c6-8ade-49ff-97a3-53a4acdf37f2 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:15.295758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b03f01-cb93-4c38-b6c6-90727d74b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:15.297091 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b03f01-cb93-4c38-b6c6-90727d74b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:15.297571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b03f01-cb93-4c38-b6c6-90727d74b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:15.298007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b03f01-cb93-4c38-b6c6-90727d74b0d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:15.298905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b03f01-cb93-4c38-b6c6-90727d74b0d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:15.300672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b03f01-cb93-4c38-b6c6-90727d74b0d6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-49b03f01-cb93-4c38-b6c6-90727d74b0d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:15.315451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:15.316765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 17:08:15.317830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:15.320514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 349/701] 10.222.0.64 () {56 vars in 1129 bytes} [Fri May 13 17:08:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:15.325976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b03f01-cb93-4c38-b6c6-90727d74b0d6 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:15.462959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525577c6-8ade-49ff-97a3-53a4acdf37f2 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:15.490452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b03f01-cb93-4c38-b6c6-90727d74b0d6 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:15.527895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e2b2a-bac2-4c9a-8833-5a57d70b5d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:15.528875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e2b2a-bac2-4c9a-8833-5a57d70b5d53 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:15.529312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e2b2a-bac2-4c9a-8833-5a57d70b5d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:15.529739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e2b2a-bac2-4c9a-8833-5a57d70b5d53 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:15.530880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e2b2a-bac2-4c9a-8833-5a57d70b5d53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:15.531370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e2b2a-bac2-4c9a-8833-5a57d70b5d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:15.533014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e2b2a-bac2-4c9a-8833-5a57d70b5d53 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:15.547632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 353/702] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:15.552303 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4f156-646e-43e7-8d24-9b4686f7cbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:15.552858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e2b2a-bac2-4c9a-8833-5a57d70b5d53 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:15.553672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4f156-646e-43e7-8d24-9b4686f7cbde None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:15.554483 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4f156-646e-43e7-8d24-9b4686f7cbde None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:15.555287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4f156-646e-43e7-8d24-9b4686f7cbde None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:15.557732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4f156-646e-43e7-8d24-9b4686f7cbde None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:15.558267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4f156-646e-43e7-8d24-9b4686f7cbde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:15.560739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4f156-646e-43e7-8d24-9b4686f7cbde None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:15.572276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 350/703] 10.222.0.64 () {56 vars in 1124 bytes} [Fri May 13 17:08:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:15.577736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4f156-646e-43e7-8d24-9b4686f7cbde None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:15.688091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e2b2a-bac2-4c9a-8833-5a57d70b5d53 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:15.698187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4f156-646e-43e7-8d24-9b4686f7cbde None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:15.725714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6cb27-030e-4a58-9da8-876da9845ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:15.726746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6cb27-030e-4a58-9da8-876da9845ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:15.727218 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6cb27-030e-4a58-9da8-876da9845ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:15.727648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6cb27-030e-4a58-9da8-876da9845ff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:15.738743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe1a39-c67f-4b19-a7ac-91e66d6243e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:15.739083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6cb27-030e-4a58-9da8-876da9845ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:15.739435 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1a39-c67f-4b19-a7ac-91e66d6243e8 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:15.739715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1a39-c67f-4b19-a7ac-91e66d6243e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:15.739990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1a39-c67f-4b19-a7ac-91e66d6243e8 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:15.740697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe1a39-c67f-4b19-a7ac-91e66d6243e8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:15.741000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe1a39-c67f-4b19-a7ac-91e66d6243e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:15.741563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6cb27-030e-4a58-9da8-876da9845ff4 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:15.742370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe1a39-c67f-4b19-a7ac-91e66d6243e8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:15.749032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 351/704] 10.222.0.64 () {56 vars in 1124 bytes} [Fri May 13 17:08:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:15.750763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad3880-ee7f-4753-af0f-0b0bb513c744 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:15.751050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad3880-ee7f-4753-af0f-0b0bb513c744 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:15.751390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad3880-ee7f-4753-af0f-0b0bb513c744 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:15.757595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 352/705] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:15.759056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33155b-2d94-4e75-b890-3a2125536a43 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:15.759394 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33155b-2d94-4e75-b890-3a2125536a43 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:15.759674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33155b-2d94-4e75-b890-3a2125536a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-cfc6cb27-030e-4a58-9da8-876da9845ff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:15.761538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:15.762581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:15.763536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:15.763536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:15.763536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:15.763536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:15.765459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 354/706] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:15.776268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6cb27-030e-4a58-9da8-876da9845ff4 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:15.777930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-2f33155b-2d94-4e75-b890-3a2125536a43 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:15.779142 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2f33155b-2d94-4e75-b890-3a2125536a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:15.858035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 353/707] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:08:15.883266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33155b-2d94-4e75-b890-3a2125536a43 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:16.006458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6cb27-030e-4a58-9da8-876da9845ff4 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:16.011716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33155b-2d94-4e75-b890-3a2125536a43 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:16.044455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d00a0-f8b0-4770-a4be-3897f58fb546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:16.045495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d00a0-f8b0-4770-a4be-3897f58fb546 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.045949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d00a0-f8b0-4770-a4be-3897f58fb546 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.046387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d00a0-f8b0-4770-a4be-3897f58fb546 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.047327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d00a0-f8b0-4770-a4be-3897f58fb546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:16.047805 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d00a0-f8b0-4770-a4be-3897f58fb546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:16.049952 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d00a0-f8b0-4770-a4be-3897f58fb546 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:16.052580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38214be-8e21-4e97-b496-9a9bf4451d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:16.053861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38214be-8e21-4e97-b496-9a9bf4451d9e None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.054151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38214be-8e21-4e97-b496-9a9bf4451d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.054425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38214be-8e21-4e97-b496-9a9bf4451d9e None admin] PATH_INFO: `/v3/services/network` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.055091 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38214be-8e21-4e97-b496-9a9bf4451d9e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:16.056533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38214be-8e21-4e97-b496-9a9bf4451d9e None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:16.066045 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 355/708] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-a38214be-8e21-4e97-b496-9a9bf4451d9e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:16.070803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:16.072169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:16.073996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 354/709] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:15 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:16.076120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d00a0-f8b0-4770-a4be-3897f58fb546 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:16.078129 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38214be-8e21-4e97-b496-9a9bf4451d9e None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:16.194947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38214be-8e21-4e97-b496-9a9bf4451d9e None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:16.231573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac807c-6f54-4dd5-b52a-cffefc27911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:16.232386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac807c-6f54-4dd5-b52a-cffefc27911c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.232675 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac807c-6f54-4dd5-b52a-cffefc27911c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.232951 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac807c-6f54-4dd5-b52a-cffefc27911c None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.233660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac807c-6f54-4dd5-b52a-cffefc27911c None admin] RBAC: Adding query filter params (name=network) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:16.239148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac807c-6f54-4dd5-b52a-cffefc27911c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:16.239148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac807c-6f54-4dd5-b52a-cffefc27911c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:16.241178 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 355/710] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:16.242693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d00a0-f8b0-4770-a4be-3897f58fb546 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:16.246495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac807c-6f54-4dd5-b52a-cffefc27911c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:16.324704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791553db-1df7-402f-9775-ffb6247e1154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:16.325923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791553db-1df7-402f-9775-ffb6247e1154 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.326421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791553db-1df7-402f-9775-ffb6247e1154 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.326907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791553db-1df7-402f-9775-ffb6247e1154 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.344455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791553db-1df7-402f-9775-ffb6247e1154 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:16.346417 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791553db-1df7-402f-9775-ffb6247e1154 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:16.359672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac807c-6f54-4dd5-b52a-cffefc27911c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-791553db-1df7-402f-9775-ffb6247e1154 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:16.375794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:16.377482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:16.378414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:16.378414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:16.378414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:16.378414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:16.378414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:16.378414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:16.378414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:16.378414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:16.378414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:16.378414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:16.389996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 356/711] 10.222.0.64 () {56 vars in 1093 bytes} [Fri May 13 17:08:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:16.395015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791553db-1df7-402f-9775-ffb6247e1154 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:16.412447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ff8f3-2042-4180-9632-257df0981d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:16.413140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ff8f3-2042-4180-9632-257df0981d18 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.413429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ff8f3-2042-4180-9632-257df0981d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.413707 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ff8f3-2042-4180-9632-257df0981d18 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.414434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ff8f3-2042-4180-9632-257df0981d18 None admin] RBAC: Adding query filter params (type=network) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:16.414772 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ff8f3-2042-4180-9632-257df0981d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:16.416158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ff8f3-2042-4180-9632-257df0981d18 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:16.433614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 356/712] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:16.487399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d049-7cea-4ba5-9828-c4e5a61ac42b None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.487716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d049-7cea-4ba5-9828-c4e5a61ac42b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.487970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d049-7cea-4ba5-9828-c4e5a61ac42b None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.489630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 357/713] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:16.495320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0aa47-2eb4-436a-a134-57787c4c1c60 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.495620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0aa47-2eb4-436a-a134-57787c4c1c60 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.495883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0aa47-2eb4-436a-a134-57787c4c1c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.514269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c8b0aa47-2eb4-436a-a134-57787c4c1c60 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:16.515411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c8b0aa47-2eb4-436a-a134-57787c4c1c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:16.517686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791553db-1df7-402f-9775-ffb6247e1154 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:16.565599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad288b-faed-45e1-a2a1-83ade24e4faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:16.566666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad288b-faed-45e1-a2a1-83ade24e4faf None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.566955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad288b-faed-45e1-a2a1-83ade24e4faf None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.567266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad288b-faed-45e1-a2a1-83ade24e4faf None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.568457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad288b-faed-45e1-a2a1-83ade24e4faf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:16.569066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad288b-faed-45e1-a2a1-83ade24e4faf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:16.570763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad288b-faed-45e1-a2a1-83ade24e4faf None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:16.597406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 357/714] 10.222.0.64 () {56 vars in 1133 bytes} [Fri May 13 17:08:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:16.598914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfb85-71fc-4c37-88ea-5fbfa09ffcd4 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.599232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfb85-71fc-4c37-88ea-5fbfa09ffcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.599512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfb85-71fc-4c37-88ea-5fbfa09ffcd4 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.601143 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 358/715] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:16.602918 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfb85-71fc-4c37-88ea-5fbfa09ffcd4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:16.603539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 358/716] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:08:16.608038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32fe63-18a9-4b74-a1e5-5e25a044588c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.608341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32fe63-18a9-4b74-a1e5-5e25a044588c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.608592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32fe63-18a9-4b74-a1e5-5e25a044588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.637328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-1e32fe63-18a9-4b74-a1e5-5e25a044588c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:16.638564 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-1e32fe63-18a9-4b74-a1e5-5e25a044588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:16.727151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 359/717] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 17:08:16.728338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32fe63-18a9-4b74-a1e5-5e25a044588c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:16.745356 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfb85-71fc-4c37-88ea-5fbfa09ffcd4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:16.792604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6960093-9880-4bff-9815-e644bdef260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:16.793184 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6960093-9880-4bff-9815-e644bdef260e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.793465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6960093-9880-4bff-9815-e644bdef260e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.793742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6960093-9880-4bff-9815-e644bdef260e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.860175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32fe63-18a9-4b74-a1e5-5e25a044588c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:16.869219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6960093-9880-4bff-9815-e644bdef260e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:16.871674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6960093-9880-4bff-9815-e644bdef260e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:16.898631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925f4b4-5d2c-439f-8b4f-39761ea77679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:16.899469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925f4b4-5d2c-439f-8b4f-39761ea77679 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:16.899754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925f4b4-5d2c-439f-8b4f-39761ea77679 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:16.900034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925f4b4-5d2c-439f-8b4f-39761ea77679 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:16.912767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925f4b4-5d2c-439f-8b4f-39761ea77679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-f925f4b4-5d2c-439f-8b4f-39761ea77679 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:16.922722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:16.924277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:16.925161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 360/718] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:16.925901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925f4b4-5d2c-439f-8b4f-39761ea77679 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:16.994403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 359/719] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:08:16.994403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6960093-9880-4bff-9815-e644bdef260e None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.043859 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925f4b4-5d2c-439f-8b4f-39761ea77679 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.082502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6ecc1-1831-4807-ac68-afd9cbc40741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.083620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ecc1-1831-4807-ac68-afd9cbc40741 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.084079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ecc1-1831-4807-ac68-afd9cbc40741 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.084589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ecc1-1831-4807-ac68-afd9cbc40741 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:17.095201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6ecc1-1831-4807-ac68-afd9cbc40741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:17.099511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6960093-9880-4bff-9815-e644bdef260e None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-59c6ecc1-1831-4807-ac68-afd9cbc40741 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:17.104090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:17.105017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:17.105841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:17.109565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 361/720] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:17.110553 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6ecc1-1831-4807-ac68-afd9cbc40741 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.142708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b5866-7381-424e-9954-8d80be80835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.143410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b5866-7381-424e-9954-8d80be80835e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.143697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b5866-7381-424e-9954-8d80be80835e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.143971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b5866-7381-424e-9954-8d80be80835e None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:17.144713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b5866-7381-424e-9954-8d80be80835e None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:17.145023 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b5866-7381-424e-9954-8d80be80835e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:17.146408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b5866-7381-424e-9954-8d80be80835e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:17.154480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 360/721] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:17.155443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b5866-7381-424e-9954-8d80be80835e None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.242287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6ecc1-1831-4807-ac68-afd9cbc40741 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.268841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b5866-7381-424e-9954-8d80be80835e None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.287172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4830d-fbfd-4c1d-ba54-2e4e35e26aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.288289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4830d-fbfd-4c1d-ba54-2e4e35e26aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.288572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4830d-fbfd-4c1d-ba54-2e4e35e26aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.288845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4830d-fbfd-4c1d-ba54-2e4e35e26aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:17.303040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4830d-fbfd-4c1d-ba54-2e4e35e26aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:17.304474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4830d-fbfd-4c1d-ba54-2e4e35e26aa2 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:17.305586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40dfbc-d089-4509-9197-1d3c1d358da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.306374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40dfbc-d089-4509-9197-1d3c1d358da6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.306803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40dfbc-d089-4509-9197-1d3c1d358da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.307224 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40dfbc-d089-4509-9197-1d3c1d358da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:17.308720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40dfbc-d089-4509-9197-1d3c1d358da6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:17.309213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40dfbc-d089-4509-9197-1d3c1d358da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:17.310708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40dfbc-d089-4509-9197-1d3c1d358da6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:17.319484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 361/722] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:17.320515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40dfbc-d089-4509-9197-1d3c1d358da6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-94e4830d-fbfd-4c1d-ba54-2e4e35e26aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:17.327915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:17.329046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:17.330010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:17.330010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:17.330010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:17.330010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:17.330010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 362/723] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:17.335502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4830d-fbfd-4c1d-ba54-2e4e35e26aa2 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.425958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40dfbc-d089-4509-9197-1d3c1d358da6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.452884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4830d-fbfd-4c1d-ba54-2e4e35e26aa2 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.459347 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ec884-68a3-4521-91df-a32deeeb4ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.460146 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ec884-68a3-4521-91df-a32deeeb4ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.460425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ec884-68a3-4521-91df-a32deeeb4ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.460698 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ec884-68a3-4521-91df-a32deeeb4ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:17.471823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ec884-68a3-4521-91df-a32deeeb4ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:17.473432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ec884-68a3-4521-91df-a32deeeb4ff2 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:17.487430 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23346259-a18f-45e7-8351-49c3003a79d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.488375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23346259-a18f-45e7-8351-49c3003a79d4 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.488766 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23346259-a18f-45e7-8351-49c3003a79d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.489158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23346259-a18f-45e7-8351-49c3003a79d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-066ec884-68a3-4521-91df-a32deeeb4ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:17.492848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:17.493898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:17.495000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:17.495000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:17.495000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:17.495000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:17.498713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 362/724] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:17.499566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ec884-68a3-4521-91df-a32deeeb4ff2 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.502798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23346259-a18f-45e7-8351-49c3003a79d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:17.504401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23346259-a18f-45e7-8351-49c3003a79d4 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-23346259-a18f-45e7-8351-49c3003a79d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:17.521775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:17.522810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:17.523917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:17.523917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:17.523917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:17.523917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:17.529823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 363/725] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:17.530731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23346259-a18f-45e7-8351-49c3003a79d4 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.601359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ec884-68a3-4521-91df-a32deeeb4ff2 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.629646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23346259-a18f-45e7-8351-49c3003a79d4 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.635450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dc3ce-efc9-4b3a-a242-1a13d8e7c4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.636116 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc3ce-efc9-4b3a-a242-1a13d8e7c4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.636398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc3ce-efc9-4b3a-a242-1a13d8e7c4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.636677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc3ce-efc9-4b3a-a242-1a13d8e7c4e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:17.637394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dc3ce-efc9-4b3a-a242-1a13d8e7c4e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:17.637700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dc3ce-efc9-4b3a-a242-1a13d8e7c4e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:17.639085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dc3ce-efc9-4b3a-a242-1a13d8e7c4e2 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:17.651424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 363/726] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:17.652282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dc3ce-efc9-4b3a-a242-1a13d8e7c4e2 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.667877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e319b-d8ac-4dcc-9a29-71a267dbb773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.668642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e319b-d8ac-4dcc-9a29-71a267dbb773 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.668991 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e319b-d8ac-4dcc-9a29-71a267dbb773 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.669341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e319b-d8ac-4dcc-9a29-71a267dbb773 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:17.670135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e319b-d8ac-4dcc-9a29-71a267dbb773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:17.670500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e319b-d8ac-4dcc-9a29-71a267dbb773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:17.671980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e319b-d8ac-4dcc-9a29-71a267dbb773 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:17.685482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 364/727] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:17.686361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e319b-d8ac-4dcc-9a29-71a267dbb773 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.760623 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dc3ce-efc9-4b3a-a242-1a13d8e7c4e2 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.786136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e319b-d8ac-4dcc-9a29-71a267dbb773 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.794692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a84720-6d48-4c1e-aada-8977f8bc7137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.795402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84720-6d48-4c1e-aada-8977f8bc7137 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.795743 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84720-6d48-4c1e-aada-8977f8bc7137 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.796070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84720-6d48-4c1e-aada-8977f8bc7137 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:17.796811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a84720-6d48-4c1e-aada-8977f8bc7137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:17.797113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a84720-6d48-4c1e-aada-8977f8bc7137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:17.799060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a84720-6d48-4c1e-aada-8977f8bc7137 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:17.811298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 364/728] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:17.812155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a84720-6d48-4c1e-aada-8977f8bc7137 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.826452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9eec3-b0e0-46b5-875b-442e187aa793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.827279 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9eec3-b0e0-46b5-875b-442e187aa793 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.827560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9eec3-b0e0-46b5-875b-442e187aa793 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.827832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9eec3-b0e0-46b5-875b-442e187aa793 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:17.834849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9eec3-b0e0-46b5-875b-442e187aa793 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:17.836359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9eec3-b0e0-46b5-875b-442e187aa793 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-e5f9eec3-b0e0-46b5-875b-442e187aa793 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:17.850111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:17.852333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:17.854539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:17.854539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:17.854539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:17.854539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:17.854539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:17.854539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:17.854539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:17.854539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:17.863168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 365/729] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:17.863168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9eec3-b0e0-46b5-875b-442e187aa793 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.915304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a84720-6d48-4c1e-aada-8977f8bc7137 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.949639 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137f5fc-ce59-4254-aa7b-b207fd489fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.950452 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137f5fc-ce59-4254-aa7b-b207fd489fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.950734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137f5fc-ce59-4254-aa7b-b207fd489fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.951008 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137f5fc-ce59-4254-aa7b-b207fd489fc3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:17.961871 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9eec3-b0e0-46b5-875b-442e187aa793 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:17.962167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137f5fc-ce59-4254-aa7b-b207fd489fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:17.962167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137f5fc-ce59-4254-aa7b-b207fd489fc3 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-c137f5fc-ce59-4254-aa7b-b207fd489fc3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:17.976145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:17.978348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:17.980704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:17.980704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:17.980704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:17.980704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:17.980704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:17.980704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:17.980704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:17.980704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:17.980704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:17.980704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:17.982068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 365/730] 10.222.0.64 () {56 vars in 1117 bytes} [Fri May 13 17:08:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:17.987235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137f5fc-ce59-4254-aa7b-b207fd489fc3 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:17.993835 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac30f05-f56b-46bd-9e92-2a2441e00774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:17.994639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac30f05-f56b-46bd-9e92-2a2441e00774 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:17.994921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac30f05-f56b-46bd-9e92-2a2441e00774 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:17.995226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac30f05-f56b-46bd-9e92-2a2441e00774 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:18.003385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac30f05-f56b-46bd-9e92-2a2441e00774 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:18.008046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac30f05-f56b-46bd-9e92-2a2441e00774 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-6ac30f05-f56b-46bd-9e92-2a2441e00774 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:18.019290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:18.020431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:18.021399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:18.021399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:18.021399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:18.021399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:18.021399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:18.021399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:18.021399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:18.021399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:18.021399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 17:08:18.021399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:18.025573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 366/731] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:18.026403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac30f05-f56b-46bd-9e92-2a2441e00774 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:18.112135 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137f5fc-ce59-4254-aa7b-b207fd489fc3 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:18.151943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac30f05-f56b-46bd-9e92-2a2441e00774 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:18.152709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169cd02-4246-4e3e-9c9a-2603a01ae581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:18.153728 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cd02-4246-4e3e-9c9a-2603a01ae581 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:18.154954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cd02-4246-4e3e-9c9a-2603a01ae581 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:18.155471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cd02-4246-4e3e-9c9a-2603a01ae581 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:18.156442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169cd02-4246-4e3e-9c9a-2603a01ae581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:18.156933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169cd02-4246-4e3e-9c9a-2603a01ae581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:18.159102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169cd02-4246-4e3e-9c9a-2603a01ae581 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:18.179575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 366/732] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:18.180764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169cd02-4246-4e3e-9c9a-2603a01ae581 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:18.202230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baf6c6-d550-4ca0-aa6c-6d83bb3f0f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:18.203340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baf6c6-d550-4ca0-aa6c-6d83bb3f0f86 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:18.203692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baf6c6-d550-4ca0-aa6c-6d83bb3f0f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:18.204048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baf6c6-d550-4ca0-aa6c-6d83bb3f0f86 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:18.205057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3baf6c6-d550-4ca0-aa6c-6d83bb3f0f86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:18.205433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3baf6c6-d550-4ca0-aa6c-6d83bb3f0f86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:18.207660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3baf6c6-d550-4ca0-aa6c-6d83bb3f0f86 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:18.238107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 367/733] 10.222.0.64 () {56 vars in 1149 bytes} [Fri May 13 17:08:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:18.238107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baf6c6-d550-4ca0-aa6c-6d83bb3f0f86 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:18.308040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169cd02-4246-4e3e-9c9a-2603a01ae581 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:18.348454 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef9af4-e34c-43f5-a7a6-ed8004ed1e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:18.349292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9af4-e34c-43f5-a7a6-ed8004ed1e55 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:18.349679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9af4-e34c-43f5-a7a6-ed8004ed1e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:18.350061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9af4-e34c-43f5-a7a6-ed8004ed1e55 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:18.350996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef9af4-e34c-43f5-a7a6-ed8004ed1e55 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:18.351601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef9af4-e34c-43f5-a7a6-ed8004ed1e55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:18.353021 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef9af4-e34c-43f5-a7a6-ed8004ed1e55 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:18.357495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baf6c6-d550-4ca0-aa6c-6d83bb3f0f86 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:18.375831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 367/734] 10.222.0.64 () {56 vars in 1135 bytes} [Fri May 13 17:08:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:18.377419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef9af4-e34c-43f5-a7a6-ed8004ed1e55 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:18.394200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff1201-c203-45e0-8390-474f085a3d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:18.395118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff1201-c203-45e0-8390-474f085a3d5e None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:18.395615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff1201-c203-45e0-8390-474f085a3d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:18.396064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff1201-c203-45e0-8390-474f085a3d5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:18.397035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff1201-c203-45e0-8390-474f085a3d5e None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=efbbecde248c44c7b1d5f3c9522a48a2) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:18.397496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff1201-c203-45e0-8390-474f085a3d5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:18.399087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff1201-c203-45e0-8390-474f085a3d5e None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:18.405337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 368/735] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:18 2022] GET /identity/v3/role_assignments?user.id=efbbecde248c44c7b1d5f3c9522a48a2&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=2791519d9bad43318f086666b6e64a20 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:18.406589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff1201-c203-45e0-8390-474f085a3d5e None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:18.524806 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff1201-c203-45e0-8390-474f085a3d5e None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:18.528937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef9af4-e34c-43f5-a7a6-ed8004ed1e55 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:18.560725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f73bd9-1af9-4943-91c2-cacd34e50e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:18.561473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f73bd9-1af9-4943-91c2-cacd34e50e8d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:18.561826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f73bd9-1af9-4943-91c2-cacd34e50e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:18.562491 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f73bd9-1af9-4943-91c2-cacd34e50e8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:18.575426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530a24c-5e17-4bf0-95a5-1f03b9a55ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:18.576200 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530a24c-5e17-4bf0-95a5-1f03b9a55ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:18.576565 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530a24c-5e17-4bf0-95a5-1f03b9a55ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:18.576924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530a24c-5e17-4bf0-95a5-1f03b9a55ed5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:18.646742 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f73bd9-1af9-4943-91c2-cacd34e50e8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:18.648250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f73bd9-1af9-4943-91c2-cacd34e50e8d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:18.651902 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530a24c-5e17-4bf0-95a5-1f03b9a55ed5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:18.653525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530a24c-5e17-4bf0-95a5-1f03b9a55ed5 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:18.776532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 369/736] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:08:18.778146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8cace-aebe-41bb-8eab-72e58ea3d4b7 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:18.778431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8cace-aebe-41bb-8eab-72e58ea3d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:18.778712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8cace-aebe-41bb-8eab-72e58ea3d4b7 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:18.780466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 370/737] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:18.781266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8cace-aebe-41bb-8eab-72e58ea3d4b7 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:18.891082 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 368/738] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 17:08:18.892465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814f886-f4d4-43ad-a276-43e5ce6604dd None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:18.892749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814f886-f4d4-43ad-a276-43e5ce6604dd None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:18.893021 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814f886-f4d4-43ad-a276-43e5ce6604dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:18.899070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8cace-aebe-41bb-8eab-72e58ea3d4b7 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:18.909647 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c814f886-f4d4-43ad-a276-43e5ce6604dd None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:18.910852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c814f886-f4d4-43ad-a276-43e5ce6604dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:18.934791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908fabe-e247-4890-90de-ef071bb198dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:18.935619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908fabe-e247-4890-90de-ef071bb198dd None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:18.935896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908fabe-e247-4890-90de-ef071bb198dd None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:18.936164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908fabe-e247-4890-90de-ef071bb198dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:18.946654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908fabe-e247-4890-90de-ef071bb198dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:18.948150 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908fabe-e247-4890-90de-ef071bb198dd None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-5908fabe-e247-4890-90de-ef071bb198dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:18.968622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:18.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:18.971171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:18.971171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:18.971171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:18.971171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:18.971171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 371/739] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:18.971991 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48514f14-fa30-4921-9c87-113f86e69086 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:18.971991 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48514f14-fa30-4921-9c87-113f86e69086 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:18.972163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48514f14-fa30-4921-9c87-113f86e69086 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:18.975255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 372/740] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:18.975255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48514f14-fa30-4921-9c87-113f86e69086 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:18.984616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 369/741] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:18.985635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814f886-f4d4-43ad-a276-43e5ce6604dd None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:19.086808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814f886-f4d4-43ad-a276-43e5ce6604dd None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:19.090940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48514f14-fa30-4921-9c87-113f86e69086 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:19.120391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091d027-3c08-4a60-a7d2-5d20e034f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:19.121061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091d027-3c08-4a60-a7d2-5d20e034f5ae None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:19.121338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091d027-3c08-4a60-a7d2-5d20e034f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:19.121610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091d027-3c08-4a60-a7d2-5d20e034f5ae None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:19.122319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091d027-3c08-4a60-a7d2-5d20e034f5ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:19.122630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091d027-3c08-4a60-a7d2-5d20e034f5ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:19.124049 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091d027-3c08-4a60-a7d2-5d20e034f5ae None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:19.125371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61818e21-f5a8-4dd9-9bed-72582f247f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:19.126169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61818e21-f5a8-4dd9-9bed-72582f247f88 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:19.126482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61818e21-f5a8-4dd9-9bed-72582f247f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:19.126764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61818e21-f5a8-4dd9-9bed-72582f247f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:19.144173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 370/742] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:19.144173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bef73-b261-4e5b-9eb2-a0503227b9c8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:19.144173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bef73-b261-4e5b-9eb2-a0503227b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:19.144173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bef73-b261-4e5b-9eb2-a0503227b9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:19.149489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61818e21-f5a8-4dd9-9bed-72582f247f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:19.151531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61818e21-f5a8-4dd9-9bed-72582f247f88 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:19.160806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e63bef73-b261-4e5b-9eb2-a0503227b9c8 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:19.162008 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e63bef73-b261-4e5b-9eb2-a0503227b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-61818e21-f5a8-4dd9-9bed-72582f247f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:19.171575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:19.172563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:19.173502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:19.173502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:19.173502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:19.173502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:19.173502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 373/743] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:19.173789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61818e21-f5a8-4dd9-9bed-72582f247f88 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:19.234109 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 371/744] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 17:08:19.235318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bef73-b261-4e5b-9eb2-a0503227b9c8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:19.274364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61818e21-f5a8-4dd9-9bed-72582f247f88 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:19.308427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41669ce0-de4b-43e8-bbaa-04da5dfb39bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:19.309085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41669ce0-de4b-43e8-bbaa-04da5dfb39bc None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:19.309367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41669ce0-de4b-43e8-bbaa-04da5dfb39bc None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:19.309643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41669ce0-de4b-43e8-bbaa-04da5dfb39bc None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:19.310398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41669ce0-de4b-43e8-bbaa-04da5dfb39bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:19.311812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41669ce0-de4b-43e8-bbaa-04da5dfb39bc None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:19.338559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bef73-b261-4e5b-9eb2-a0503227b9c8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:19.370857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf3492-c731-4c79-b36d-7a777853164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:19.371666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf3492-c731-4c79-b36d-7a777853164e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:19.371947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf3492-c731-4c79-b36d-7a777853164e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:19.372218 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf3492-c731-4c79-b36d-7a777853164e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:19.379238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf3492-c731-4c79-b36d-7a777853164e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:19.380681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf3492-c731-4c79-b36d-7a777853164e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-decf3492-c731-4c79-b36d-7a777853164e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:19.394002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:19.394909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:19.396108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:19.396108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:19.396108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:19.396108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:19.396108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:19.396108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:19.396108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:19.396108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:19.396108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 372/745] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:19.396108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf3492-c731-4c79-b36d-7a777853164e None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:19.409792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 374/746] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:08:19 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:19.420304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41669ce0-de4b-43e8-bbaa-04da5dfb39bc None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:19.522242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf3492-c731-4c79-b36d-7a777853164e None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:19.573772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568b648-05c4-4440-a070-93588597a7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:19.574972 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568b648-05c4-4440-a070-93588597a7bf None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:19.575784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568b648-05c4-4440-a070-93588597a7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:19.576238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568b648-05c4-4440-a070-93588597a7bf None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:19.577167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568b648-05c4-4440-a070-93588597a7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:19.577278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41669ce0-de4b-43e8-bbaa-04da5dfb39bc None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:19.577772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568b648-05c4-4440-a070-93588597a7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:19.579775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568b648-05c4-4440-a070-93588597a7bf None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:19.600596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 373/747] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:19.600596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568b648-05c4-4440-a070-93588597a7bf None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:19.632433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1811e8-ed2f-44cc-8f92-7f7d4da4cdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:19.633106 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1811e8-ed2f-44cc-8f92-7f7d4da4cdd1 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:19.633386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1811e8-ed2f-44cc-8f92-7f7d4da4cdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:19.633661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1811e8-ed2f-44cc-8f92-7f7d4da4cdd1 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:19.634382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1811e8-ed2f-44cc-8f92-7f7d4da4cdd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:19.635813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1811e8-ed2f-44cc-8f92-7f7d4da4cdd1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:19.706048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 375/748] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:08:19 2022] POST /identity/v3/services => generated 240 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:19.707349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1811e8-ed2f-44cc-8f92-7f7d4da4cdd1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:19.707880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568b648-05c4-4440-a070-93588597a7bf None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:19.768234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06b12b-851b-4885-aa19-e20842f96991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:19.769403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06b12b-851b-4885-aa19-e20842f96991 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:19.770069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06b12b-851b-4885-aa19-e20842f96991 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:19.772240 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06b12b-851b-4885-aa19-e20842f96991 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:19.773353 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06b12b-851b-4885-aa19-e20842f96991 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:19.773901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06b12b-851b-4885-aa19-e20842f96991 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:19.776376 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06b12b-851b-4885-aa19-e20842f96991 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:19.800872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 374/749] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:19.807464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06b12b-851b-4885-aa19-e20842f96991 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:19.898102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1811e8-ed2f-44cc-8f92-7f7d4da4cdd1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:19.932957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd749cb0-aff2-4f76-b8e7-fcfa0ccb57ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:19.934582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd749cb0-aff2-4f76-b8e7-fcfa0ccb57ed None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:19.934933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd749cb0-aff2-4f76-b8e7-fcfa0ccb57ed None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:19.935306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd749cb0-aff2-4f76-b8e7-fcfa0ccb57ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:19.943158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd749cb0-aff2-4f76-b8e7-fcfa0ccb57ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:19.944486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd749cb0-aff2-4f76-b8e7-fcfa0ccb57ed None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:19.950032 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06b12b-851b-4885-aa19-e20842f96991 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-bd749cb0-aff2-4f76-b8e7-fcfa0ccb57ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:19.959489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:19.960377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:19.961297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:19.961297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:19.961297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:19.961297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:19.961297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:19.961297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:19.961297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:19.961297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:19.961297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 376/750] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:19.968241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd749cb0-aff2-4f76-b8e7-fcfa0ccb57ed None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:19.985107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5ea19-94ee-49b5-85c7-3ca03f123d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:19.986319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5ea19-94ee-49b5-85c7-3ca03f123d90 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:19.986599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5ea19-94ee-49b5-85c7-3ca03f123d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:19.986867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5ea19-94ee-49b5-85c7-3ca03f123d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:19.987735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5ea19-94ee-49b5-85c7-3ca03f123d90 None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=973cc524d553428aa2b2763ce28cc920) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:19.988041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5ea19-94ee-49b5-85c7-3ca03f123d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:19.989498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5ea19-94ee-49b5-85c7-3ca03f123d90 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:19.996963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 375/751] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:19 2022] GET /identity/v3/role_assignments?user.id=973cc524d553428aa2b2763ce28cc920&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=2791519d9bad43318f086666b6e64a20 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:20.089491 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd749cb0-aff2-4f76-b8e7-fcfa0ccb57ed None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:20.127546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553b844-3e48-4b69-8b0d-66e400d99208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:20.128233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553b844-3e48-4b69-8b0d-66e400d99208 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:20.128518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553b844-3e48-4b69-8b0d-66e400d99208 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:20.128798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553b844-3e48-4b69-8b0d-66e400d99208 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:20.129611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553b844-3e48-4b69-8b0d-66e400d99208 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:20.129922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553b844-3e48-4b69-8b0d-66e400d99208 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:20.131545 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553b844-3e48-4b69-8b0d-66e400d99208 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:20.145469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 377/752] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:20.151550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5ea19-94ee-49b5-85c7-3ca03f123d90 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:20.256015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5ea19-94ee-49b5-85c7-3ca03f123d90 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:20.289055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f68b4b-d6e8-425a-9567-01704c488ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:20.289710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f68b4b-d6e8-425a-9567-01704c488ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:20.289991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f68b4b-d6e8-425a-9567-01704c488ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:20.290270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f68b4b-d6e8-425a-9567-01704c488ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:20.291099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f68b4b-d6e8-425a-9567-01704c488ea7 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=762c7aace59a4d02bf76f1e59bb21f0e) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:20.291439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f68b4b-d6e8-425a-9567-01704c488ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:20.292909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f68b4b-d6e8-425a-9567-01704c488ea7 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:20.299887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 376/753] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:20 2022] GET /identity/v3/role_assignments?user.id=762c7aace59a4d02bf76f1e59bb21f0e&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:20.978856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16c0a0-93aa-48e0-a6ed-a669f22b2b63 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:20.979610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16c0a0-93aa-48e0-a6ed-a669f22b2b63 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:20.979610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16c0a0-93aa-48e0-a6ed-a669f22b2b63 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:20.981087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 378/754] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:20.986828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bcce9-db70-4f75-b790-0cdf55bf35d7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:20.987121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bcce9-db70-4f75-b790-0cdf55bf35d7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:20.987423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bcce9-db70-4f75-b790-0cdf55bf35d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:21.009402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-703bcce9-db70-4f75-b790-0cdf55bf35d7 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:21.010586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-703bcce9-db70-4f75-b790-0cdf55bf35d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:21.081716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 377/755] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:21.109907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16c0a0-93aa-48e0-a6ed-a669f22b2b63 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:21.223291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16c0a0-93aa-48e0-a6ed-a669f22b2b63 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:21.257869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb0869-2b5a-4e9d-8fda-24c889274062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:21.258595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0869-2b5a-4e9d-8fda-24c889274062 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:21.258884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0869-2b5a-4e9d-8fda-24c889274062 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:21.259172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0869-2b5a-4e9d-8fda-24c889274062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:21.270180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb0869-2b5a-4e9d-8fda-24c889274062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-70eb0869-2b5a-4e9d-8fda-24c889274062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:21.277896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:21.280096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:21.282010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 379/756] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:21.288446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bcce9-db70-4f75-b790-0cdf55bf35d7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:21.429988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bcce9-db70-4f75-b790-0cdf55bf35d7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:21.482519 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368833cc-5eda-4448-ab97-3ce3584c75e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:21.483606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368833cc-5eda-4448-ab97-3ce3584c75e1 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:21.484089 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368833cc-5eda-4448-ab97-3ce3584c75e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:21.484583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368833cc-5eda-4448-ab97-3ce3584c75e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:21.485525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368833cc-5eda-4448-ab97-3ce3584c75e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:21.486651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368833cc-5eda-4448-ab97-3ce3584c75e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:21.488299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368833cc-5eda-4448-ab97-3ce3584c75e1 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:21.503928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 378/757] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:21.509564 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb0869-2b5a-4e9d-8fda-24c889274062 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:21.760088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb0869-2b5a-4e9d-8fda-24c889274062 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:21.794282 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220413f-adaa-4ae1-b731-cb587298c8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:21.795152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220413f-adaa-4ae1-b731-cb587298c8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:21.795439 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220413f-adaa-4ae1-b731-cb587298c8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:21.795718 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220413f-adaa-4ae1-b731-cb587298c8c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:21.806557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220413f-adaa-4ae1-b731-cb587298c8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:21.808054 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220413f-adaa-4ae1-b731-cb587298c8c7 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-2220413f-adaa-4ae1-b731-cb587298c8c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:21.826234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:21.827190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:21.828070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:21.828070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:21.828070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:21.828070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:21.828070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 380/758] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:21.836227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368833cc-5eda-4448-ab97-3ce3584c75e1 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:21.999255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368833cc-5eda-4448-ab97-3ce3584c75e1 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:22.038661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59258c88-7957-4629-beb8-ee887856ec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:22.039327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59258c88-7957-4629-beb8-ee887856ec61 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.039607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59258c88-7957-4629-beb8-ee887856ec61 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.039879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59258c88-7957-4629-beb8-ee887856ec61 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.040598 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59258c88-7957-4629-beb8-ee887856ec61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:22.040898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59258c88-7957-4629-beb8-ee887856ec61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:22.042279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59258c88-7957-4629-beb8-ee887856ec61 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:22.054817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 379/759] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:22.060485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220413f-adaa-4ae1-b731-cb587298c8c7 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:22.152246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d3a2-1300-45e9-bf57-198139f0d01a None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.152595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d3a2-1300-45e9-bf57-198139f0d01a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.152790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d3a2-1300-45e9-bf57-198139f0d01a None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.154130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 380/760] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:22.165060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648b3bd-3058-4a37-8645-8668167ce95b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.165344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648b3bd-3058-4a37-8645-8668167ce95b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.165619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648b3bd-3058-4a37-8645-8668167ce95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.185166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4648b3bd-3058-4a37-8645-8668167ce95b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:22.186362 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4648b3bd-3058-4a37-8645-8668167ce95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:22.262511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 381/761] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:22.265761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220413f-adaa-4ae1-b731-cb587298c8c7 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:22.308116 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648b3bd-3058-4a37-8645-8668167ce95b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:22.326511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4dd97-3588-4e7b-a25f-3ed0ca44f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:22.327290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4dd97-3588-4e7b-a25f-3ed0ca44f4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.327575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4dd97-3588-4e7b-a25f-3ed0ca44f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.327844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4dd97-3588-4e7b-a25f-3ed0ca44f4e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.338192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4dd97-3588-4e7b-a25f-3ed0ca44f4e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:22.339681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4dd97-3588-4e7b-a25f-3ed0ca44f4e6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-54d4dd97-3588-4e7b-a25f-3ed0ca44f4e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:22.369878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:22.370891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:22.371857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:22.371857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:22.371857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:22.371857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:22.371857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:22.371857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:22.371857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:22.371857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:22.371857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:22.371857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:22.371857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 381/762] 10.222.0.64 () {56 vars in 1093 bytes} [Fri May 13 17:08:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:22.376738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4dd97-3588-4e7b-a25f-3ed0ca44f4e6 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:22.416803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648b3bd-3058-4a37-8645-8668167ce95b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:22.460400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31fa97-b5ad-49eb-a249-39daef21893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:22.461474 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31fa97-b5ad-49eb-a249-39daef21893b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.461909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31fa97-b5ad-49eb-a249-39daef21893b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.462359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31fa97-b5ad-49eb-a249-39daef21893b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.463190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31fa97-b5ad-49eb-a249-39daef21893b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:22.464786 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31fa97-b5ad-49eb-a249-39daef21893b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-7a31fa97-b5ad-49eb-a249-39daef21893b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:22.491092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:22.492378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 17:08:22.493456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:22.497332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 382/763] 10.222.0.64 () {56 vars in 1129 bytes} [Fri May 13 17:08:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:22.504386 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31fa97-b5ad-49eb-a249-39daef21893b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:22.591709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4dd97-3588-4e7b-a25f-3ed0ca44f4e6 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:22.657403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e623b7-cc3e-4564-af1d-5ed8e5d22fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:22.658603 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e623b7-cc3e-4564-af1d-5ed8e5d22fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.658885 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e623b7-cc3e-4564-af1d-5ed8e5d22fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.659182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e623b7-cc3e-4564-af1d-5ed8e5d22fd1 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.660026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e623b7-cc3e-4564-af1d-5ed8e5d22fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:22.660332 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e623b7-cc3e-4564-af1d-5ed8e5d22fd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:22.661768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e623b7-cc3e-4564-af1d-5ed8e5d22fd1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:22.672868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31fa97-b5ad-49eb-a249-39daef21893b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:22.679935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 382/764] 10.222.0.64 () {56 vars in 1133 bytes} [Fri May 13 17:08:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:22.685267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e623b7-cc3e-4564-af1d-5ed8e5d22fd1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:22.721040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e909d-604f-46ca-bc17-d8482646b950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:22.722078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e909d-604f-46ca-bc17-d8482646b950 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.722527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e909d-604f-46ca-bc17-d8482646b950 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.722955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e909d-604f-46ca-bc17-d8482646b950 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.723849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e909d-604f-46ca-bc17-d8482646b950 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:22.724325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e909d-604f-46ca-bc17-d8482646b950 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:22.725884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e909d-604f-46ca-bc17-d8482646b950 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:22.738020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 383/765] 10.222.0.64 () {56 vars in 1124 bytes} [Fri May 13 17:08:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:22.752435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e909d-604f-46ca-bc17-d8482646b950 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:22.790665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e623b7-cc3e-4564-af1d-5ed8e5d22fd1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:22.825624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87ea93-a381-4bb7-8a79-492379c19a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:22.826481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87ea93-a381-4bb7-8a79-492379c19a59 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.826727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87ea93-a381-4bb7-8a79-492379c19a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.827005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87ea93-a381-4bb7-8a79-492379c19a59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.839261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87ea93-a381-4bb7-8a79-492379c19a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:22.840753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87ea93-a381-4bb7-8a79-492379c19a59 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-bd87ea93-a381-4bb7-8a79-492379c19a59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:22.860492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:22.861466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:22.862371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:22.862371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:22.862371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:22.862371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:22.862371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 383/766] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:22.863079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f6301-ef86-41b5-8791-dd0a15235147 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.863319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f6301-ef86-41b5-8791-dd0a15235147 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.863465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f6301-ef86-41b5-8791-dd0a15235147 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.868713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 384/767] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:22.868713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23620d7-e657-4b66-8655-aa611f5ec8de None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.868713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23620d7-e657-4b66-8655-aa611f5ec8de None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.868713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23620d7-e657-4b66-8655-aa611f5ec8de None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.868713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 385/768] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:22.868713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23620d7-e657-4b66-8655-aa611f5ec8de None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:22.882815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e909d-604f-46ca-bc17-d8482646b950 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:22.917943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18105187-286a-448b-8f2a-02bed6a9a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:22.919216 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18105187-286a-448b-8f2a-02bed6a9a802 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.919711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18105187-286a-448b-8f2a-02bed6a9a802 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.920172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18105187-286a-448b-8f2a-02bed6a9a802 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.921479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18105187-286a-448b-8f2a-02bed6a9a802 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:22.922011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18105187-286a-448b-8f2a-02bed6a9a802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:22.924477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18105187-286a-448b-8f2a-02bed6a9a802 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:22.930887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 384/769] 10.222.0.64 () {56 vars in 1124 bytes} [Fri May 13 17:08:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:22.932180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88b36-a30f-4c3d-90de-9afb2f97b3d6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:22.933700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88b36-a30f-4c3d-90de-9afb2f97b3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:22.933991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88b36-a30f-4c3d-90de-9afb2f97b3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:22.952719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2be88b36-a30f-4c3d-90de-9afb2f97b3d6 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:22.953912 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2be88b36-a30f-4c3d-90de-9afb2f97b3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:22.978138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23620d7-e657-4b66-8655-aa611f5ec8de None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.014958 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c567b-f5db-450d-9e78-d47e602c1f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.015648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c567b-f5db-450d-9e78-d47e602c1f14 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.015929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c567b-f5db-450d-9e78-d47e602c1f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.016202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c567b-f5db-450d-9e78-d47e602c1f14 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.017507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c567b-f5db-450d-9e78-d47e602c1f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:23.017815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c567b-f5db-450d-9e78-d47e602c1f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:23.019201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c567b-f5db-450d-9e78-d47e602c1f14 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:23.030879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 385/770] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:23.030879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891ccd9-4dde-447e-834c-7ae8c8c76a4e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.030879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891ccd9-4dde-447e-834c-7ae8c8c76a4e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.030879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891ccd9-4dde-447e-834c-7ae8c8c76a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.036499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 386/771] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:23.037265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c567b-f5db-450d-9e78-d47e602c1f14 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:23.046079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0891ccd9-4dde-447e-834c-7ae8c8c76a4e None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:23.047311 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0891ccd9-4dde-447e-834c-7ae8c8c76a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:23.111535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 386/772] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:23.112858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a76262-18ba-4669-99ae-59831fe9483a None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.113145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a76262-18ba-4669-99ae-59831fe9483a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.113420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a76262-18ba-4669-99ae-59831fe9483a None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.115404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 387/773] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:23.115404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a76262-18ba-4669-99ae-59831fe9483a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:23.132627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c567b-f5db-450d-9e78-d47e602c1f14 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.164814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824af95-708d-4c96-bc3b-69ee2610bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.165471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824af95-708d-4c96-bc3b-69ee2610bed0 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.165755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824af95-708d-4c96-bc3b-69ee2610bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.166027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824af95-708d-4c96-bc3b-69ee2610bed0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.166811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824af95-708d-4c96-bc3b-69ee2610bed0 None admin] RBAC: Adding query filter params (interface=public, service_id=8f990017fa5644eca87c27cbc82c5e07, region_id=RegionOne) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:23.167121 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824af95-708d-4c96-bc3b-69ee2610bed0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:23.168519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824af95-708d-4c96-bc3b-69ee2610bed0 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:23.176107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 387/774] 10.222.0.64 () {56 vars in 1251 bytes} [Fri May 13 17:08:23 2022] GET /identity/v3/endpoints?service_id=8f990017fa5644eca87c27cbc82c5e07&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:23.176903 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824af95-708d-4c96-bc3b-69ee2610bed0 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:23.225486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a76262-18ba-4669-99ae-59831fe9483a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.258933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e2bc6-4cd0-45fb-a185-eeb73358556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.259748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e2bc6-4cd0-45fb-a185-eeb73358556d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.260029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e2bc6-4cd0-45fb-a185-eeb73358556d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.260304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e2bc6-4cd0-45fb-a185-eeb73358556d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.266723 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e2bc6-4cd0-45fb-a185-eeb73358556d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:23.268780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e2bc6-4cd0-45fb-a185-eeb73358556d None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:23.278111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824af95-708d-4c96-bc3b-69ee2610bed0 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-cc7e2bc6-4cd0-45fb-a185-eeb73358556d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:23.282124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:23.283036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:23.283973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:23.283973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:23.283973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:23.283973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:23.283973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:23.283973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:23.283973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:23.283973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:23.283973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 388/775] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:23.284746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e9d5b-37b1-4db8-91fd-1949a0a63d38 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.284848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e9d5b-37b1-4db8-91fd-1949a0a63d38 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.285117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e9d5b-37b1-4db8-91fd-1949a0a63d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.300836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ab3e9d5b-37b1-4db8-91fd-1949a0a63d38 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:23.302022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ab3e9d5b-37b1-4db8-91fd-1949a0a63d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:23.309361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997a808-76f7-4c93-946a-1d7e32bbac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.310142 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997a808-76f7-4c93-946a-1d7e32bbac51 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.310423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997a808-76f7-4c93-946a-1d7e32bbac51 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.310696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997a808-76f7-4c93-946a-1d7e32bbac51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.320742 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997a808-76f7-4c93-946a-1d7e32bbac51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-d997a808-76f7-4c93-946a-1d7e32bbac51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:23.328568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:23.330299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 388/776] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:23.336309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997a808-76f7-4c93-946a-1d7e32bbac51 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:23.368433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 389/777] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:23.369209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e9d5b-37b1-4db8-91fd-1949a0a63d38 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:23.425642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997a808-76f7-4c93-946a-1d7e32bbac51 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.458409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a191-e621-439a-a256-e567799c4e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.459220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a191-e621-439a-a256-e567799c4e9a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.459506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a191-e621-439a-a256-e567799c4e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.459780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a191-e621-439a-a256-e567799c4e9a None admin] PATH_INFO: `/v3/services/network` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.460429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6a191-e621-439a-a256-e567799c4e9a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:23.461811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6a191-e621-439a-a256-e567799c4e9a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:23.462621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e9d5b-37b1-4db8-91fd-1949a0a63d38 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-00c6a191-e621-439a-a256-e567799c4e9a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:23.473405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:23.474423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:23.475284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 389/778] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:23 2022] GET /identity/v3/services/network => generated 88 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:23.476086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a191-e621-439a-a256-e567799c4e9a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:23.499490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c84e1-5081-4c9f-9789-e06ebe0e6a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.500142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c84e1-5081-4c9f-9789-e06ebe0e6a29 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.500421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c84e1-5081-4c9f-9789-e06ebe0e6a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.500690 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c84e1-5081-4c9f-9789-e06ebe0e6a29 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.501914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c84e1-5081-4c9f-9789-e06ebe0e6a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:23.503307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c84e1-5081-4c9f-9789-e06ebe0e6a29 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:23.508099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 390/779] 10.222.0.64 () {56 vars in 1087 bytes} [Fri May 13 17:08:23 2022] GET /identity/v3/services => generated 772 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:23.508855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c84e1-5081-4c9f-9789-e06ebe0e6a29 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:23.577700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a191-e621-439a-a256-e567799c4e9a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.612872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c4a4a-263f-430d-9b51-96e0b9d329ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.613550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c4a4a-263f-430d-9b51-96e0b9d329ab None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.613837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c4a4a-263f-430d-9b51-96e0b9d329ab None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.613940 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c84e1-5081-4c9f-9789-e06ebe0e6a29 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.614116 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c4a4a-263f-430d-9b51-96e0b9d329ab None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.614920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c4a4a-263f-430d-9b51-96e0b9d329ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:23.615269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c4a4a-263f-430d-9b51-96e0b9d329ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:23.616770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c4a4a-263f-430d-9b51-96e0b9d329ab None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:23.633581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 390/780] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:23.633581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c4a4a-263f-430d-9b51-96e0b9d329ab None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:23.655482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef62056-4dcd-4075-b724-1498e15055e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.656160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef62056-4dcd-4075-b724-1498e15055e0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.656439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef62056-4dcd-4075-b724-1498e15055e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.656707 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef62056-4dcd-4075-b724-1498e15055e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.657490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef62056-4dcd-4075-b724-1498e15055e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:23.657793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef62056-4dcd-4075-b724-1498e15055e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:23.659297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef62056-4dcd-4075-b724-1498e15055e0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:23.672587 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 391/781] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:23.672587 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef62056-4dcd-4075-b724-1498e15055e0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:23.734898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c4a4a-263f-430d-9b51-96e0b9d329ab None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.769169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30b05-ec23-4cff-9846-8bbeb22a6419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.770371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30b05-ec23-4cff-9846-8bbeb22a6419 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.770887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30b05-ec23-4cff-9846-8bbeb22a6419 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.771388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30b05-ec23-4cff-9846-8bbeb22a6419 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.775227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef62056-4dcd-4075-b724-1498e15055e0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.781832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef30b05-ec23-4cff-9846-8bbeb22a6419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-eef30b05-ec23-4cff-9846-8bbeb22a6419 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:23.789810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:23.790775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:23.791826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:23.794152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 391/782] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:23.795114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30b05-ec23-4cff-9846-8bbeb22a6419 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:23.812187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4b99a-6b15-4084-9bfc-8ee37302fb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.812852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4b99a-6b15-4084-9bfc-8ee37302fb7a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.813130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4b99a-6b15-4084-9bfc-8ee37302fb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.813401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4b99a-6b15-4084-9bfc-8ee37302fb7a None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.814663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4b99a-6b15-4084-9bfc-8ee37302fb7a None admin] RBAC: Adding query filter params (name=network) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:23.814967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4b99a-6b15-4084-9bfc-8ee37302fb7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:23.816373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4b99a-6b15-4084-9bfc-8ee37302fb7a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:23.820771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 392/783] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:23.821537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4b99a-6b15-4084-9bfc-8ee37302fb7a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:23.908534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30b05-ec23-4cff-9846-8bbeb22a6419 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.925132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4b99a-6b15-4084-9bfc-8ee37302fb7a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:23.940731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb474ad-afa6-4efc-bb6d-5d3c20d1c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.941617 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb474ad-afa6-4efc-bb6d-5d3c20d1c303 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.941901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb474ad-afa6-4efc-bb6d-5d3c20d1c303 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.942177 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb474ad-afa6-4efc-bb6d-5d3c20d1c303 None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/efbbecde248c44c7b1d5f3c9522a48a2/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.944190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb474ad-afa6-4efc-bb6d-5d3c20d1c303 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=efbbecde248c44c7b1d5f3c9522a48a2, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:23.945747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb474ad-afa6-4efc-bb6d-5d3c20d1c303 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:23.957843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1723396-8f46-4965-adbe-056640219eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:23.958759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1723396-8f46-4965-adbe-056640219eef None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:23.959038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1723396-8f46-4965-adbe-056640219eef None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:23.959360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1723396-8f46-4965-adbe-056640219eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:23.969875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1723396-8f46-4965-adbe-056640219eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:23.971870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1723396-8f46-4965-adbe-056640219eef None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-f1723396-8f46-4965-adbe-056640219eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:23.990708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:23.995681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:23.997077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:23.997077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:23.997077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:23.997077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:23.997077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 393/784] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:23.997077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1723396-8f46-4965-adbe-056640219eef None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:24.017838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 392/785] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:08:23 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/efbbecde248c44c7b1d5f3c9522a48a2/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:08:24.018928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb474ad-afa6-4efc-bb6d-5d3c20d1c303 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:24.102710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1723396-8f46-4965-adbe-056640219eef None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:24.137485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb474ad-afa6-4efc-bb6d-5d3c20d1c303 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:24.140563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74793df-9408-4cd9-a0a3-a4e1650a610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:24.141429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74793df-9408-4cd9-a0a3-a4e1650a610f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:24.141913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74793df-9408-4cd9-a0a3-a4e1650a610f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:24.142340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74793df-9408-4cd9-a0a3-a4e1650a610f None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:24.143305 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74793df-9408-4cd9-a0a3-a4e1650a610f None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:24.143761 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74793df-9408-4cd9-a0a3-a4e1650a610f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:24.145391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74793df-9408-4cd9-a0a3-a4e1650a610f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:24.156545 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 394/786] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:24.158239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74793df-9408-4cd9-a0a3-a4e1650a610f None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:24.174233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89034b27-f5a6-4149-9035-fd7e39d69f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:24.174841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89034b27-f5a6-4149-9035-fd7e39d69f2c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:24.175146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89034b27-f5a6-4149-9035-fd7e39d69f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:24.175433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89034b27-f5a6-4149-9035-fd7e39d69f2c None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:24.176165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89034b27-f5a6-4149-9035-fd7e39d69f2c None admin] RBAC: Adding query filter params (type=network) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:24.176475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89034b27-f5a6-4149-9035-fd7e39d69f2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:24.177915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89034b27-f5a6-4149-9035-fd7e39d69f2c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:24.183753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 393/787] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:24.185100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89034b27-f5a6-4149-9035-fd7e39d69f2c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:24.280363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74793df-9408-4cd9-a0a3-a4e1650a610f None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:24.301278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89034b27-f5a6-4149-9035-fd7e39d69f2c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:24.326811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17666375-f2da-4660-852d-1f710f81c31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:24.328093 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17666375-f2da-4660-852d-1f710f81c31c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:24.328458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17666375-f2da-4660-852d-1f710f81c31c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:24.328764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17666375-f2da-4660-852d-1f710f81c31c None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:24.330489 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17666375-f2da-4660-852d-1f710f81c31c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:24.330997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17666375-f2da-4660-852d-1f710f81c31c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:24.332649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17666375-f2da-4660-852d-1f710f81c31c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:24.337924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e95316-f47b-4640-bfef-d029ded8a23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:24.338981 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95316-f47b-4640-bfef-d029ded8a23f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:24.339488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95316-f47b-4640-bfef-d029ded8a23f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:24.339944 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95316-f47b-4640-bfef-d029ded8a23f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:24.354614 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 395/788] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:24.354614 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17666375-f2da-4660-852d-1f710f81c31c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:24.356235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e95316-f47b-4640-bfef-d029ded8a23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:24.357974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e95316-f47b-4640-bfef-d029ded8a23f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-97e95316-f47b-4640-bfef-d029ded8a23f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:24.376290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:24.377756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:24.378655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:24.378655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:24.378655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:24.378655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:24.381035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 394/789] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:24.382056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e95316-f47b-4640-bfef-d029ded8a23f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:24.475155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17666375-f2da-4660-852d-1f710f81c31c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:24.482953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e95316-f47b-4640-bfef-d029ded8a23f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:24.517390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b1ea3-b5cd-4eef-9581-cf4b1cddbbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:24.517617 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4035b98-bfb1-41e2-b0af-a5483b89b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:24.518064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4035b98-bfb1-41e2-b0af-a5483b89b8cc None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:24.518351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4035b98-bfb1-41e2-b0af-a5483b89b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:24.518628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4035b98-bfb1-41e2-b0af-a5483b89b8cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:24.519234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b1ea3-b5cd-4eef-9581-cf4b1cddbbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:24.519447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4035b98-bfb1-41e2-b0af-a5483b89b8cc None admin] RBAC: Adding query filter params (interface=public, service_id=89d5d00d03784c038e0e4b16ca23d8f5, region_id=RegionOne) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:24.519762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4035b98-bfb1-41e2-b0af-a5483b89b8cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:24.520138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b1ea3-b5cd-4eef-9581-cf4b1cddbbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:24.520592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b1ea3-b5cd-4eef-9581-cf4b1cddbbb0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:24.521154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4035b98-bfb1-41e2-b0af-a5483b89b8cc None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:24.528552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b1ea3-b5cd-4eef-9581-cf4b1cddbbb0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:24.529836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 396/790] 10.222.0.64 () {56 vars in 1251 bytes} [Fri May 13 17:08:24 2022] GET /identity/v3/endpoints?service_id=89d5d00d03784c038e0e4b16ca23d8f5&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:24.530723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b1ea3-b5cd-4eef-9581-cf4b1cddbbb0 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:24.530835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4035b98-bfb1-41e2-b0af-a5483b89b8cc None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-aa3b1ea3-b5cd-4eef-9581-cf4b1cddbbb0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:24.548833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:24.549825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:24.550793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:24.550793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:24.550793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:24.550793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:24.550793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:24.550793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:24.550793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:24.550793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:24.550793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 17:08:24.550793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:24.553025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 395/791] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:24.554074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b1ea3-b5cd-4eef-9581-cf4b1cddbbb0 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:24.643602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4035b98-bfb1-41e2-b0af-a5483b89b8cc None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:24.662002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b1ea3-b5cd-4eef-9581-cf4b1cddbbb0 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:24.683657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49fac6-411d-462d-b926-8fe66e1111c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:24.684586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fac6-411d-462d-b926-8fe66e1111c6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:24.684712 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fac6-411d-462d-b926-8fe66e1111c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:24.684948 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fac6-411d-462d-b926-8fe66e1111c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:24.685690 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49fac6-411d-462d-b926-8fe66e1111c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:24.686000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49fac6-411d-462d-b926-8fe66e1111c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:24.687462 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49fac6-411d-462d-b926-8fe66e1111c6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:24.700182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e6015-054e-4670-97ef-df33756c4a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:24.700370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 397/792] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:24.701213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49fac6-411d-462d-b926-8fe66e1111c6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:24.701696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e6015-054e-4670-97ef-df33756c4a18 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:24.702166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e6015-054e-4670-97ef-df33756c4a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:24.702624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e6015-054e-4670-97ef-df33756c4a18 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:24.703554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e6015-054e-4670-97ef-df33756c4a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:24.705512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e6015-054e-4670-97ef-df33756c4a18 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:24.711237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 396/793] 10.222.0.64 () {56 vars in 1087 bytes} [Fri May 13 17:08:24 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:24.712253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e6015-054e-4670-97ef-df33756c4a18 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:24.823394 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e6015-054e-4670-97ef-df33756c4a18 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:24.839860 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49fac6-411d-462d-b926-8fe66e1111c6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:24.859929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b340a86-2b48-4810-8e4b-17eee3d247a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:24.861158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340a86-2b48-4810-8e4b-17eee3d247a0 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:24.861644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340a86-2b48-4810-8e4b-17eee3d247a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:24.862110 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340a86-2b48-4810-8e4b-17eee3d247a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:24.871052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b340a86-2b48-4810-8e4b-17eee3d247a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:24.873243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b340a86-2b48-4810-8e4b-17eee3d247a0 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:24.875874 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d20d2f-4655-4bdc-80ff-aeac5e3c5918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:24.877450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d20d2f-4655-4bdc-80ff-aeac5e3c5918 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:24.877450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d20d2f-4655-4bdc-80ff-aeac5e3c5918 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:24.877628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d20d2f-4655-4bdc-80ff-aeac5e3c5918 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:24.878432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d20d2f-4655-4bdc-80ff-aeac5e3c5918 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:24.878737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d20d2f-4655-4bdc-80ff-aeac5e3c5918 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:24.880206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d20d2f-4655-4bdc-80ff-aeac5e3c5918 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-7b340a86-2b48-4810-8e4b-17eee3d247a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:24.891038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:24.892643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:24.893574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:24.893574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:24.893574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:24.893574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:24.893574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:24.893574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:24.893574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:24.893574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:24.893574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:24.893574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:24.896307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 397/794] 10.222.0.64 () {56 vars in 1117 bytes} [Fri May 13 17:08:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:24.901287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 398/795] 10.222.0.64 () {56 vars in 1135 bytes} [Fri May 13 17:08:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:24.902617 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b340a86-2b48-4810-8e4b-17eee3d247a0 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:24.905004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d20d2f-4655-4bdc-80ff-aeac5e3c5918 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:25.068081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b340a86-2b48-4810-8e4b-17eee3d247a0 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:25.068547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d20d2f-4655-4bdc-80ff-aeac5e3c5918 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:25.103751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc54f25-bc29-4180-8944-f70352b1cdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:25.104349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc54f25-bc29-4180-8944-f70352b1cdca None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:25.104633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc54f25-bc29-4180-8944-f70352b1cdca None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:25.104914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc54f25-bc29-4180-8944-f70352b1cdca None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:25.105755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc54f25-bc29-4180-8944-f70352b1cdca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:25.106065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc54f25-bc29-4180-8944-f70352b1cdca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:25.107541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc54f25-bc29-4180-8944-f70352b1cdca None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:25.107740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ad485-79dc-4fc5-9f90-ec06b91c0240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:25.108532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ad485-79dc-4fc5-9f90-ec06b91c0240 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:25.108811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ad485-79dc-4fc5-9f90-ec06b91c0240 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:25.109078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ad485-79dc-4fc5-9f90-ec06b91c0240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:25.119288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ad485-79dc-4fc5-9f90-ec06b91c0240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:25.120756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ad485-79dc-4fc5-9f90-ec06b91c0240 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:25.125003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 398/796] 10.222.0.64 () {56 vars in 1149 bytes} [Fri May 13 17:08:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:25.130217 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc54f25-bc29-4180-8944-f70352b1cdca None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-cd7ad485-79dc-4fc5-9f90-ec06b91c0240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:25.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:25.139986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:25.140969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:25.140969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:25.140969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:25.140969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:25.140969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 399/797] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:25.146480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ad485-79dc-4fc5-9f90-ec06b91c0240 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:25.258679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ad485-79dc-4fc5-9f90-ec06b91c0240 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:25.267983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc54f25-bc29-4180-8944-f70352b1cdca None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:25.293365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a11fe2-cf84-42f2-a491-c8cdfdde8483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:25.294442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a11fe2-cf84-42f2-a491-c8cdfdde8483 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:25.294923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a11fe2-cf84-42f2-a491-c8cdfdde8483 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:25.295423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a11fe2-cf84-42f2-a491-c8cdfdde8483 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:25.296350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a11fe2-cf84-42f2-a491-c8cdfdde8483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:25.296851 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a11fe2-cf84-42f2-a491-c8cdfdde8483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:25.298968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a11fe2-cf84-42f2-a491-c8cdfdde8483 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:25.315338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 400/798] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:25.317138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b84b8-9ad7-4717-8505-e079b7ea1f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:25.318221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b84b8-9ad7-4717-8505-e079b7ea1f49 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:25.318721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b84b8-9ad7-4717-8505-e079b7ea1f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:25.319272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b84b8-9ad7-4717-8505-e079b7ea1f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:25.320709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a11fe2-cf84-42f2-a491-c8cdfdde8483 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:25.342609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b84b8-9ad7-4717-8505-e079b7ea1f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:25.344461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b84b8-9ad7-4717-8505-e079b7ea1f49 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-946b84b8-9ad7-4717-8505-e079b7ea1f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:25.375519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:25.377065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:25.377968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:25.377968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:25.377968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:25.377968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:25.380289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 399/799] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:25.385732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b84b8-9ad7-4717-8505-e079b7ea1f49 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:25.455175 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a11fe2-cf84-42f2-a491-c8cdfdde8483 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:25.519017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d4099-01f0-4c21-b56a-1f0b1cd09145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:25.520682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4099-01f0-4c21-b56a-1f0b1cd09145 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:25.521163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4099-01f0-4c21-b56a-1f0b1cd09145 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:25.521633 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4099-01f0-4c21-b56a-1f0b1cd09145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:25.533149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d4099-01f0-4c21-b56a-1f0b1cd09145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:25.535628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d4099-01f0-4c21-b56a-1f0b1cd09145 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:25.542395 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b84b8-9ad7-4717-8505-e079b7ea1f49 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-6d9d4099-01f0-4c21-b56a-1f0b1cd09145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:25.566694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:25.567673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:25.568540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:25.568540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:25.568540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:25.568540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:25.568540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:25.568540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:25.568540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:25.568540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:25.570891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 401/800] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:25.576891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d4099-01f0-4c21-b56a-1f0b1cd09145 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:25.611013 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5651b-c32a-4299-aeab-32c94ce7930a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:25.612075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5651b-c32a-4299-aeab-32c94ce7930a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:25.612553 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5651b-c32a-4299-aeab-32c94ce7930a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:25.613022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5651b-c32a-4299-aeab-32c94ce7930a None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:25.613937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5651b-c32a-4299-aeab-32c94ce7930a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:25.615412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5651b-c32a-4299-aeab-32c94ce7930a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:25.617164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5651b-c32a-4299-aeab-32c94ce7930a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:25.641982 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 400/801] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:25.648371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5651b-c32a-4299-aeab-32c94ce7930a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:25.756760 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d4099-01f0-4c21-b56a-1f0b1cd09145 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:25.817992 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5651b-c32a-4299-aeab-32c94ce7930a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:25.827867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa415-eae6-4710-b3dd-38f3df51edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:25.828556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa415-eae6-4710-b3dd-38f3df51edf5 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:25.828842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa415-eae6-4710-b3dd-38f3df51edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:25.829117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa415-eae6-4710-b3dd-38f3df51edf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:25.830462 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa415-eae6-4710-b3dd-38f3df51edf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:25.830772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa415-eae6-4710-b3dd-38f3df51edf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:25.832276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa415-eae6-4710-b3dd-38f3df51edf5 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:25.853672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baed95-f7ad-4d0c-8d21-d30c3b4e9813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:25.853875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 402/802] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:25.854585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baed95-f7ad-4d0c-8d21-d30c3b4e9813 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:25.854872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baed95-f7ad-4d0c-8d21-d30c3b4e9813 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:25.855263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baed95-f7ad-4d0c-8d21-d30c3b4e9813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:25.859718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa415-eae6-4710-b3dd-38f3df51edf5 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:25.863284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baed95-f7ad-4d0c-8d21-d30c3b4e9813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:25.864820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baed95-f7ad-4d0c-8d21-d30c3b4e9813 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-c6baed95-f7ad-4d0c-8d21-d30c3b4e9813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:25.881494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:25.882418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:25.883329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:25.883329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:25.883329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:25.883329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:25.883329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:25.883329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:25.883329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:25.883329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:25.883329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 401/803] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:25.889964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baed95-f7ad-4d0c-8d21-d30c3b4e9813 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:26.024331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa415-eae6-4710-b3dd-38f3df51edf5 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:26.038636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baed95-f7ad-4d0c-8d21-d30c3b4e9813 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:26.059706 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa0561-89fd-4763-8dc2-61d28102aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:26.060672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0561-89fd-4763-8dc2-61d28102aa08 None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:26.060958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0561-89fd-4763-8dc2-61d28102aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:26.061234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0561-89fd-4763-8dc2-61d28102aa08 None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/973cc524d553428aa2b2763ce28cc920/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:26.063375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa0561-89fd-4763-8dc2-61d28102aa08 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=973cc524d553428aa2b2763ce28cc920, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:26.065413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa0561-89fd-4763-8dc2-61d28102aa08 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:26.078849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddadad0-942d-41ca-8f3f-046b8ae424c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:26.084316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddadad0-942d-41ca-8f3f-046b8ae424c8 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:26.084316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddadad0-942d-41ca-8f3f-046b8ae424c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:26.084316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddadad0-942d-41ca-8f3f-046b8ae424c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:26.084316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddadad0-942d-41ca-8f3f-046b8ae424c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:26.084316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddadad0-942d-41ca-8f3f-046b8ae424c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:26.084316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddadad0-942d-41ca-8f3f-046b8ae424c8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:26.094202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 402/804] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:26.095351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833cf72-b656-4c8e-86e7-8ce23a9dc39f None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:26.095716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833cf72-b656-4c8e-86e7-8ce23a9dc39f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:26.096068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833cf72-b656-4c8e-86e7-8ce23a9dc39f None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:26.097572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 403/805] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:26.102103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833cf72-b656-4c8e-86e7-8ce23a9dc39f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:26.149423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 403/806] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:08:25 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/973cc524d553428aa2b2763ce28cc920/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:08:26.151802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb48e24-760d-4114-99df-10341510a397 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:26.152728 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb48e24-760d-4114-99df-10341510a397 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:26.153263 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb48e24-760d-4114-99df-10341510a397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:26.178090 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-feb48e24-760d-4114-99df-10341510a397 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:26.179701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-feb48e24-760d-4114-99df-10341510a397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:26.228225 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833cf72-b656-4c8e-86e7-8ce23a9dc39f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:26.304291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc92c3-239e-4df4-918a-a18d9cdf7fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:26.305119 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc92c3-239e-4df4-918a-a18d9cdf7fc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:26.305403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc92c3-239e-4df4-918a-a18d9cdf7fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:26.305682 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc92c3-239e-4df4-918a-a18d9cdf7fc3 None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/762c7aace59a4d02bf76f1e59bb21f0e/roles/7e1ae9fbefc24173bab81ecbd3889e94` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:26.317230 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 404/807] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:26.335246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc92c3-239e-4df4-918a-a18d9cdf7fc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=762c7aace59a4d02bf76f1e59bb21f0e, role_id=7e1ae9fbefc24173bab81ecbd3889e94)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:26.340375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc92c3-239e-4df4-918a-a18d9cdf7fc3 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:26.359180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb48e24-760d-4114-99df-10341510a397 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:26.421406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 404/808] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:08:26 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/762c7aace59a4d02bf76f1e59bb21f0e/roles/7e1ae9fbefc24173bab81ecbd3889e94 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:08:26.480386 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb48e24-760d-4114-99df-10341510a397 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:26.523561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cd2ad-7e7b-4850-ae8e-184b1117d28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:26.524540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd2ad-7e7b-4850-ae8e-184b1117d28d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:26.524854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd2ad-7e7b-4850-ae8e-184b1117d28d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:26.525127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd2ad-7e7b-4850-ae8e-184b1117d28d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:26.525987 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cd2ad-7e7b-4850-ae8e-184b1117d28d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:26.527503 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cd2ad-7e7b-4850-ae8e-184b1117d28d None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-f56cd2ad-7e7b-4850-ae8e-184b1117d28d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:26.541593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:26.542621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:26.543929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 405/809] 10.222.0.64 () {56 vars in 1129 bytes} [Fri May 13 17:08:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:26.549237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc92c3-239e-4df4-918a-a18d9cdf7fc3 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:26.563413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f8182-9fb2-4a58-b72e-f12884d77d9c None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:26.563631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f8182-9fb2-4a58-b72e-f12884d77d9c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:26.564001 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f8182-9fb2-4a58-b72e-f12884d77d9c None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:26.566371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 406/810] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:26.576552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4176ba3-13ed-43f4-9d8d-549c16101abf None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:26.576820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4176ba3-13ed-43f4-9d8d-549c16101abf None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:26.577108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4176ba3-13ed-43f4-9d8d-549c16101abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:26.615121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d4176ba3-13ed-43f4-9d8d-549c16101abf None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:26.616523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d4176ba3-13ed-43f4-9d8d-549c16101abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:26.697253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc92c3-239e-4df4-918a-a18d9cdf7fc3 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:26.712959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 407/811] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:26.749232 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70b217-8613-480d-9d38-b2bfdc028310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:26.749910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70b217-8613-480d-9d38-b2bfdc028310 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:26.750198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70b217-8613-480d-9d38-b2bfdc028310 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:26.750475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70b217-8613-480d-9d38-b2bfdc028310 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:26.751236 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70b217-8613-480d-9d38-b2bfdc028310 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:26.751552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70b217-8613-480d-9d38-b2bfdc028310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:26.752930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70b217-8613-480d-9d38-b2bfdc028310 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:26.761907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4176ba3-13ed-43f4-9d8d-549c16101abf None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:26.762423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 405/812] 10.222.0.64 () {56 vars in 1124 bytes} [Fri May 13 17:08:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:26.768348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70b217-8613-480d-9d38-b2bfdc028310 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:26.915750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4176ba3-13ed-43f4-9d8d-549c16101abf None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:26.928801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70b217-8613-480d-9d38-b2bfdc028310 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:26.975151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f056de-526f-4ba8-b0b8-4b7208066f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:26.976184 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f056de-526f-4ba8-b0b8-4b7208066f8a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:26.978032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f056de-526f-4ba8-b0b8-4b7208066f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:26.978536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f056de-526f-4ba8-b0b8-4b7208066f8a None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:26.979484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f056de-526f-4ba8-b0b8-4b7208066f8a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:26.981566 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f056de-526f-4ba8-b0b8-4b7208066f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:26.983184 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f056de-526f-4ba8-b0b8-4b7208066f8a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:26.991788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 406/813] 10.222.0.64 () {56 vars in 1124 bytes} [Fri May 13 17:08:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:26.995251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89230d2-74ee-4ca8-a715-30b6fadb228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:26.996385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89230d2-74ee-4ca8-a715-30b6fadb228d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:26.996879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89230d2-74ee-4ca8-a715-30b6fadb228d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:26.997377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89230d2-74ee-4ca8-a715-30b6fadb228d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:27.000328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f056de-526f-4ba8-b0b8-4b7208066f8a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:27.009631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89230d2-74ee-4ca8-a715-30b6fadb228d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-b89230d2-74ee-4ca8-a715-30b6fadb228d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:27.017892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:27.023672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:27.024855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 408/814] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:27.032332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89230d2-74ee-4ca8-a715-30b6fadb228d None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:27.121219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f056de-526f-4ba8-b0b8-4b7208066f8a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:27.155059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96008eb1-615c-4e40-98a5-e72a204b6542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:27.156887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96008eb1-615c-4e40-98a5-e72a204b6542 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:27.157170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96008eb1-615c-4e40-98a5-e72a204b6542 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:27.157990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96008eb1-615c-4e40-98a5-e72a204b6542 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:27.158734 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96008eb1-615c-4e40-98a5-e72a204b6542 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:27.167524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96008eb1-615c-4e40-98a5-e72a204b6542 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:27.203428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89230d2-74ee-4ca8-a715-30b6fadb228d None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:27.241391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3041f-6bf6-4d63-a71a-ceba99c7440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:27.242075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3041f-6bf6-4d63-a71a-ceba99c7440e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:27.242356 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3041f-6bf6-4d63-a71a-ceba99c7440e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:27.252174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3041f-6bf6-4d63-a71a-ceba99c7440e None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:27.252174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3041f-6bf6-4d63-a71a-ceba99c7440e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:27.252174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3041f-6bf6-4d63-a71a-ceba99c7440e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:27.252174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3041f-6bf6-4d63-a71a-ceba99c7440e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:27.256693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 409/815] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:27.264101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3041f-6bf6-4d63-a71a-ceba99c7440e None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:27.297077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 407/816] 10.222.0.64 () {60 vars in 1144 bytes} [Fri May 13 17:08:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:27.397376 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3041f-6bf6-4d63-a71a-ceba99c7440e None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:27.444117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89656e-18d0-49c0-b919-392e8976d371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:27.444838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89656e-18d0-49c0-b919-392e8976d371 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:27.445117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89656e-18d0-49c0-b919-392e8976d371 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:27.445391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89656e-18d0-49c0-b919-392e8976d371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:27.456841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89656e-18d0-49c0-b919-392e8976d371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:27.458333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89656e-18d0-49c0-b919-392e8976d371 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-0f89656e-18d0-49c0-b919-392e8976d371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:27.477185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:27.478149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:27.479520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:27.479520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:27.479520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:27.479520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:27.479520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 410/817] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:27.484445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96008eb1-615c-4e40-98a5-e72a204b6542 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:27.613141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96008eb1-615c-4e40-98a5-e72a204b6542 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:27.635352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d440-c9e7-4378-8035-417dc477fd42 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:27.635867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d440-c9e7-4378-8035-417dc477fd42 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:27.635945 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d440-c9e7-4378-8035-417dc477fd42 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:27.637385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 411/818] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:27.643478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a14d-df7f-4f32-becc-f32e5ec5fd7b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:27.643770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a14d-df7f-4f32-becc-f32e5ec5fd7b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:27.644049 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a14d-df7f-4f32-becc-f32e5ec5fd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:27.663089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f539a9-0e5f-4e42-9b1d-f1bb7d8f5f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:27.664236 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f539a9-0e5f-4e42-9b1d-f1bb7d8f5f51 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:27.664776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f539a9-0e5f-4e42-9b1d-f1bb7d8f5f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:27.665266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f539a9-0e5f-4e42-9b1d-f1bb7d8f5f51 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:27.666220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f539a9-0e5f-4e42-9b1d-f1bb7d8f5f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:27.666738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f539a9-0e5f-4e42-9b1d-f1bb7d8f5f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:27.668373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f539a9-0e5f-4e42-9b1d-f1bb7d8f5f51 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:27.670143 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5778a14d-df7f-4f32-becc-f32e5ec5fd7b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:27.671933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5778a14d-df7f-4f32-becc-f32e5ec5fd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:27.685101 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 408/819] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:27.692115 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f539a9-0e5f-4e42-9b1d-f1bb7d8f5f51 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:27.770847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 412/820] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:27.805497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778a14d-df7f-4f32-becc-f32e5ec5fd7b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:27.816357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f539a9-0e5f-4e42-9b1d-f1bb7d8f5f51 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:27.888579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dac42-b7d2-4c95-91ce-4193cfb73f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:27.891797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dac42-b7d2-4c95-91ce-4193cfb73f47 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:27.892388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dac42-b7d2-4c95-91ce-4193cfb73f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:27.892869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dac42-b7d2-4c95-91ce-4193cfb73f47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:27.903771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66dac42-b7d2-4c95-91ce-4193cfb73f47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:27.905635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66dac42-b7d2-4c95-91ce-4193cfb73f47 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-a66dac42-b7d2-4c95-91ce-4193cfb73f47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:27.923105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:27.924568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:27.925511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:27.925511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:27.925511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:27.925511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:27.925511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:27.925511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:27.925511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:27.925511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:27.925511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:27.925511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:27.928244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 409/821] 10.222.0.64 () {56 vars in 1093 bytes} [Fri May 13 17:08:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:27.936029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dac42-b7d2-4c95-91ce-4193cfb73f47 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:27.975391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778a14d-df7f-4f32-becc-f32e5ec5fd7b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:28.013404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba47dd7-c64e-4938-b49a-edb5914b52c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:28.015624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba47dd7-c64e-4938-b49a-edb5914b52c7 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:28.015624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba47dd7-c64e-4938-b49a-edb5914b52c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:28.015624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba47dd7-c64e-4938-b49a-edb5914b52c7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:28.015624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba47dd7-c64e-4938-b49a-edb5914b52c7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:28.017024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba47dd7-c64e-4938-b49a-edb5914b52c7 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-4ba47dd7-c64e-4938-b49a-edb5914b52c7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:28.029101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:28.030101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:28.030931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 413/822] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:27 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:28.038151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba47dd7-c64e-4938-b49a-edb5914b52c7 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:28.148105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba47dd7-c64e-4938-b49a-edb5914b52c7 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:28.149380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dac42-b7d2-4c95-91ce-4193cfb73f47 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:28.186197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265e36c-0b10-4642-b570-add2a763de46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:28.186865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e36c-0b10-4642-b570-add2a763de46 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:28.187157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e36c-0b10-4642-b570-add2a763de46 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:28.187443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e36c-0b10-4642-b570-add2a763de46 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:28.188145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265e36c-0b10-4642-b570-add2a763de46 None admin] RBAC: Adding query filter params (name=network) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:28.188447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265e36c-0b10-4642-b570-add2a763de46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:28.190451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265e36c-0b10-4642-b570-add2a763de46 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:28.199783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 414/823] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:28.202250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265e36c-0b10-4642-b570-add2a763de46 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:28.232763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e32088-9d71-49e3-b6b1-464289ba5c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:28.233451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e32088-9d71-49e3-b6b1-464289ba5c76 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:28.233736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e32088-9d71-49e3-b6b1-464289ba5c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:28.234018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e32088-9d71-49e3-b6b1-464289ba5c76 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:28.234866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e32088-9d71-49e3-b6b1-464289ba5c76 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:28.235196 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e32088-9d71-49e3-b6b1-464289ba5c76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:28.237197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e32088-9d71-49e3-b6b1-464289ba5c76 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:28.265683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 410/824] 10.222.0.64 () {56 vars in 1133 bytes} [Fri May 13 17:08:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:28.271072 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e32088-9d71-49e3-b6b1-464289ba5c76 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:28.310891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265e36c-0b10-4642-b570-add2a763de46 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:28.354383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99eb1c-5d7d-42c4-ba50-84b6bf70caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:28.355057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99eb1c-5d7d-42c4-ba50-84b6bf70caa8 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:28.355369 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99eb1c-5d7d-42c4-ba50-84b6bf70caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:28.357472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99eb1c-5d7d-42c4-ba50-84b6bf70caa8 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:28.358185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99eb1c-5d7d-42c4-ba50-84b6bf70caa8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:28.358494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99eb1c-5d7d-42c4-ba50-84b6bf70caa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:28.359910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99eb1c-5d7d-42c4-ba50-84b6bf70caa8 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:28.378187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 415/825] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:28.379658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99eb1c-5d7d-42c4-ba50-84b6bf70caa8 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:28.491290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e32088-9d71-49e3-b6b1-464289ba5c76 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:28.537633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b6717-8172-47ba-ad1a-f6ab309142e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:28.538294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b6717-8172-47ba-ad1a-f6ab309142e3 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:28.538575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b6717-8172-47ba-ad1a-f6ab309142e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:28.538844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b6717-8172-47ba-ad1a-f6ab309142e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:28.579605 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99eb1c-5d7d-42c4-ba50-84b6bf70caa8 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:28.631217 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441002-a453-47e7-af10-7d1319ffdc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:28.631904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441002-a453-47e7-af10-7d1319ffdc44 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:28.632184 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441002-a453-47e7-af10-7d1319ffdc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:28.632459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441002-a453-47e7-af10-7d1319ffdc44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:28.633205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441002-a453-47e7-af10-7d1319ffdc44 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:28.634603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441002-a453-47e7-af10-7d1319ffdc44 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:28.658630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b6717-8172-47ba-ad1a-f6ab309142e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:28.660176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b6717-8172-47ba-ad1a-f6ab309142e3 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:28.749119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 416/826] 10.222.0.64 () {60 vars in 1144 bytes} [Fri May 13 17:08:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:28.760720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 411/827] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 17:08:28.766254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441002-a453-47e7-af10-7d1319ffdc44 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:28.778981 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c304c5e-84ee-47dc-9f58-0add99e46fbc None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:28.779355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c304c5e-84ee-47dc-9f58-0add99e46fbc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:28.779576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c304c5e-84ee-47dc-9f58-0add99e46fbc None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:28.781093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 412/828] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:28.788473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffe66a-dcb0-40b0-8a35-6d32302b7f26 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:28.788836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffe66a-dcb0-40b0-8a35-6d32302b7f26 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:28.789088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffe66a-dcb0-40b0-8a35-6d32302b7f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:28.822696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-aaffe66a-dcb0-40b0-8a35-6d32302b7f26 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:28.823974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-aaffe66a-dcb0-40b0-8a35-6d32302b7f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:28.980518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 413/829] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:28.990563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441002-a453-47e7-af10-7d1319ffdc44 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:29.016453 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffe66a-dcb0-40b0-8a35-6d32302b7f26 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:29.032295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0d2f4-5692-4a4f-a68f-aad9c38f1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:29.033479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d2f4-5692-4a4f-a68f-aad9c38f1904 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.033966 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d2f4-5692-4a4f-a68f-aad9c38f1904 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.034470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d2f4-5692-4a4f-a68f-aad9c38f1904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.045836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0d2f4-5692-4a4f-a68f-aad9c38f1904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:29.047651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0d2f4-5692-4a4f-a68f-aad9c38f1904 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-bbd0d2f4-5692-4a4f-a68f-aad9c38f1904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:29.066937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:29.068060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:29.068953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:29.068953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:29.068953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:29.068953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:29.071170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 417/830] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:29.080164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0d2f4-5692-4a4f-a68f-aad9c38f1904 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:29.120597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffe66a-dcb0-40b0-8a35-6d32302b7f26 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:29.156525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f345d-5737-4d4d-b56e-e571840b4268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:29.157837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f345d-5737-4d4d-b56e-e571840b4268 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.158133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f345d-5737-4d4d-b56e-e571840b4268 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.158405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f345d-5737-4d4d-b56e-e571840b4268 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.169007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f345d-5737-4d4d-b56e-e571840b4268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-c54f345d-5737-4d4d-b56e-e571840b4268 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:29.177337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:29.178264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:29.179113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 414/831] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:29.180227 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30d0d4-169c-48e4-abe3-213724bd3da5 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.180519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30d0d4-169c-48e4-abe3-213724bd3da5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.180795 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30d0d4-169c-48e4-abe3-213724bd3da5 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.182039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 415/832] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:29.185351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30d0d4-169c-48e4-abe3-213724bd3da5 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:29.193707 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0d2f4-5692-4a4f-a68f-aad9c38f1904 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:29.226840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a22d9c-059f-4d8f-88c3-ca1bd045110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:29.227590 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22d9c-059f-4d8f-88c3-ca1bd045110e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.227875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22d9c-059f-4d8f-88c3-ca1bd045110e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.228152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22d9c-059f-4d8f-88c3-ca1bd045110e None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.228863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a22d9c-059f-4d8f-88c3-ca1bd045110e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:29.229169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a22d9c-059f-4d8f-88c3-ca1bd045110e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:29.230605 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a22d9c-059f-4d8f-88c3-ca1bd045110e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:29.242567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 418/833] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:29.243798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914837f-808d-4f12-a6a6-3593ef037821 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.244088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914837f-808d-4f12-a6a6-3593ef037821 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.244364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914837f-808d-4f12-a6a6-3593ef037821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.260738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9914837f-808d-4f12-a6a6-3593ef037821 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:29.261907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9914837f-808d-4f12-a6a6-3593ef037821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:29.305472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30d0d4-169c-48e4-abe3-213724bd3da5 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:29.335459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 419/834] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:29.336476 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914837f-808d-4f12-a6a6-3593ef037821 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:29.345757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f13db-caae-43e0-9c59-c035dfb4b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:29.346782 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f13db-caae-43e0-9c59-c035dfb4b68d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.347079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f13db-caae-43e0-9c59-c035dfb4b68d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.347390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f13db-caae-43e0-9c59-c035dfb4b68d None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.348149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f13db-caae-43e0-9c59-c035dfb4b68d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:29.348774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f13db-caae-43e0-9c59-c035dfb4b68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:29.350475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f13db-caae-43e0-9c59-c035dfb4b68d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:29.361615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 416/835] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:29.362635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f13db-caae-43e0-9c59-c035dfb4b68d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:29.440630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914837f-808d-4f12-a6a6-3593ef037821 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:29.459190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f13db-caae-43e0-9c59-c035dfb4b68d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:29.478448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64f018-ee2b-4024-aeeb-a13f0fddce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:29.479686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64f018-ee2b-4024-aeeb-a13f0fddce86 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.480224 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64f018-ee2b-4024-aeeb-a13f0fddce86 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.480520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64f018-ee2b-4024-aeeb-a13f0fddce86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.489962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64f018-ee2b-4024-aeeb-a13f0fddce86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:29.491626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64f018-ee2b-4024-aeeb-a13f0fddce86 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:29.492701 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53102be7-2abe-4558-80ba-d0a2959b6f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:29.493495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53102be7-2abe-4558-80ba-d0a2959b6f9b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.493778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53102be7-2abe-4558-80ba-d0a2959b6f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.494062 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53102be7-2abe-4558-80ba-d0a2959b6f9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.504016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53102be7-2abe-4558-80ba-d0a2959b6f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-3c64f018-ee2b-4024-aeeb-a13f0fddce86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:29.507487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:29.508331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:29.509211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:29.509211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:29.509211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:29.509211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:29.509211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:29.509211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:29.509211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:29.509211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:29.511379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 420/836] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-53102be7-2abe-4558-80ba-d0a2959b6f9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:29.511937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:29.512877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:29.513710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 417/837] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:08:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:29.514870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64f018-ee2b-4024-aeeb-a13f0fddce86 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:29.517944 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53102be7-2abe-4558-80ba-d0a2959b6f9b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:29.616429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53102be7-2abe-4558-80ba-d0a2959b6f9b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:29.625445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64f018-ee2b-4024-aeeb-a13f0fddce86 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:29.648846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6aae0b-cbd8-4479-a367-d30bbf50a7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:29.649499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6aae0b-cbd8-4479-a367-d30bbf50a7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.649784 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6aae0b-cbd8-4479-a367-d30bbf50a7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.650063 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6aae0b-cbd8-4479-a367-d30bbf50a7f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.650847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6aae0b-cbd8-4479-a367-d30bbf50a7f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:29.651175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6aae0b-cbd8-4479-a367-d30bbf50a7f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:29.652621 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6aae0b-cbd8-4479-a367-d30bbf50a7f8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:29.660087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fe600-cfed-4c7c-beb1-bdc3db948939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:29.661366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fe600-cfed-4c7c-beb1-bdc3db948939 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.661647 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fe600-cfed-4c7c-beb1-bdc3db948939 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.661920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fe600-cfed-4c7c-beb1-bdc3db948939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.670404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 418/838] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:29.670404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6aae0b-cbd8-4479-a367-d30bbf50a7f8 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:29.673127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fe600-cfed-4c7c-beb1-bdc3db948939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:29.674602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fe600-cfed-4c7c-beb1-bdc3db948939 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-eb7fe600-cfed-4c7c-beb1-bdc3db948939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:29.691610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:29.692561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:29.693513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:29.693513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:29.693513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:29.693513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:29.693513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 421/839] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:29.693789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fe600-cfed-4c7c-beb1-bdc3db948939 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:29.776013 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6aae0b-cbd8-4479-a367-d30bbf50a7f8 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:29.794670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fe600-cfed-4c7c-beb1-bdc3db948939 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:29.810270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72c762-8152-4d5d-9f96-d62b3f2da286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:29.811159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72c762-8152-4d5d-9f96-d62b3f2da286 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.811592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72c762-8152-4d5d-9f96-d62b3f2da286 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.812037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72c762-8152-4d5d-9f96-d62b3f2da286 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.813071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72c762-8152-4d5d-9f96-d62b3f2da286 None admin] RBAC: Adding query filter params (name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:29.813558 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72c762-8152-4d5d-9f96-d62b3f2da286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:29.814941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72c762-8152-4d5d-9f96-d62b3f2da286 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:29.822853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 419/840] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:08:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:29.823702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72c762-8152-4d5d-9f96-d62b3f2da286 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:29.832024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe74b5-3ee8-47a6-9e19-51f360f27b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:29.832693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe74b5-3ee8-47a6-9e19-51f360f27b16 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:29.832969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe74b5-3ee8-47a6-9e19-51f360f27b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:29.833251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe74b5-3ee8-47a6-9e19-51f360f27b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:29.834084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe74b5-3ee8-47a6-9e19-51f360f27b16 None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=efbbecde248c44c7b1d5f3c9522a48a2) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:29.834394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe74b5-3ee8-47a6-9e19-51f360f27b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:29.835869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe74b5-3ee8-47a6-9e19-51f360f27b16 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:29.841674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 422/841] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:29 2022] GET /identity/v3/role_assignments?user.id=efbbecde248c44c7b1d5f3c9522a48a2&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=2791519d9bad43318f086666b6e64a20 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:29.842448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe74b5-3ee8-47a6-9e19-51f360f27b16 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:29.962781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe74b5-3ee8-47a6-9e19-51f360f27b16 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:29.963819 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72c762-8152-4d5d-9f96-d62b3f2da286 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:30.001604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce300ed-8323-4bf6-ac7c-6eeac9068f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.002562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce300ed-8323-4bf6-ac7c-6eeac9068f67 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.009162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce300ed-8323-4bf6-ac7c-6eeac9068f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.009162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce300ed-8323-4bf6-ac7c-6eeac9068f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.012211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1982b-9a17-4461-b67a-216548f25383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.013586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1982b-9a17-4461-b67a-216548f25383 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.014395 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1982b-9a17-4461-b67a-216548f25383 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.014884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1982b-9a17-4461-b67a-216548f25383 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.015253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce300ed-8323-4bf6-ac7c-6eeac9068f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.016058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1982b-9a17-4461-b67a-216548f25383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:30.016559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1982b-9a17-4461-b67a-216548f25383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.017140 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce300ed-8323-4bf6-ac7c-6eeac9068f67 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:30.018387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1982b-9a17-4461-b67a-216548f25383 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:30.033958 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 420/842] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-fce300ed-8323-4bf6-ac7c-6eeac9068f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:30.039428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:30.040339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:30.041242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:30.041242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:30.041242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:30.041242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:30.042719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 423/843] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:30.044131 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce300ed-8323-4bf6-ac7c-6eeac9068f67 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:30.044348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1982b-9a17-4461-b67a-216548f25383 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:30.146636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1982b-9a17-4461-b67a-216548f25383 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:30.149870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce300ed-8323-4bf6-ac7c-6eeac9068f67 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:30.179865 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244da25-6acc-4db2-8c90-5880e7b446e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.180653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244da25-6acc-4db2-8c90-5880e7b446e8 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.180933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244da25-6acc-4db2-8c90-5880e7b446e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.181206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244da25-6acc-4db2-8c90-5880e7b446e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.184447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d9224-ad4a-4357-9916-ca2fd3fd8581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.185107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9224-ad4a-4357-9916-ca2fd3fd8581 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.185390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9224-ad4a-4357-9916-ca2fd3fd8581 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.185666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9224-ad4a-4357-9916-ca2fd3fd8581 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.186382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d9224-ad4a-4357-9916-ca2fd3fd8581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:30.186693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d9224-ad4a-4357-9916-ca2fd3fd8581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.188122 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d9224-ad4a-4357-9916-ca2fd3fd8581 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:30.188224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244da25-6acc-4db2-8c90-5880e7b446e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.189624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244da25-6acc-4db2-8c90-5880e7b446e8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:30.204480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 424/844] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:30.204480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230445d5-2ea1-4d2d-84e3-fa714d51fdab None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.204480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230445d5-2ea1-4d2d-84e3-fa714d51fdab None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.204480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230445d5-2ea1-4d2d-84e3-fa714d51fdab None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.204480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 425/845] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:30.207163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230445d5-2ea1-4d2d-84e3-fa714d51fdab None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-5244da25-6acc-4db2-8c90-5880e7b446e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:30.207496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:30.208598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:30.209764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:30.209764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:30.209764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:30.209764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:30.209764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:30.209764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:30.209764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:30.209764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:30.209764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 17:08:30.209764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:30.216243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 421/846] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:30.216243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570c5d7-22af-45e7-b574-0961ef99ab9b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.216572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570c5d7-22af-45e7-b574-0961ef99ab9b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.216706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570c5d7-22af-45e7-b574-0961ef99ab9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.233230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-b570c5d7-22af-45e7-b574-0961ef99ab9b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:30.234401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b570c5d7-22af-45e7-b574-0961ef99ab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:30.311296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 422/847] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:30.311296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570c5d7-22af-45e7-b574-0961ef99ab9b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:30.311550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230445d5-2ea1-4d2d-84e3-fa714d51fdab None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:30.341882 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed7448-bed2-4d60-ad56-1e06f7f55382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.342710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed7448-bed2-4d60-ad56-1e06f7f55382 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.342992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed7448-bed2-4d60-ad56-1e06f7f55382 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.343300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed7448-bed2-4d60-ad56-1e06f7f55382 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.351081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed7448-bed2-4d60-ad56-1e06f7f55382 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.352570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed7448-bed2-4d60-ad56-1e06f7f55382 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-aaed7448-bed2-4d60-ad56-1e06f7f55382 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:30.367579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:30.368534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:30.369482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:30.369482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:30.369482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:30.369482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:30.369482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:30.369482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:30.369482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:30.369482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:30.369482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:30.369482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:30.369482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 426/848] 10.222.0.64 () {56 vars in 1117 bytes} [Fri May 13 17:08:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:30.370081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed7448-bed2-4d60-ad56-1e06f7f55382 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:30.422741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570c5d7-22af-45e7-b574-0961ef99ab9b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:30.456659 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b77f8b-5f4e-4d86-bdab-b2f99c18b796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.457328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b77f8b-5f4e-4d86-bdab-b2f99c18b796 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.457609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b77f8b-5f4e-4d86-bdab-b2f99c18b796 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.457886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b77f8b-5f4e-4d86-bdab-b2f99c18b796 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.458721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b77f8b-5f4e-4d86-bdab-b2f99c18b796 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:30.459030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b77f8b-5f4e-4d86-bdab-b2f99c18b796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.460510 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b77f8b-5f4e-4d86-bdab-b2f99c18b796 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:30.477792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 423/849] 10.222.0.64 () {56 vars in 1135 bytes} [Fri May 13 17:08:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:30.478132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed7448-bed2-4d60-ad56-1e06f7f55382 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:30.478604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b77f8b-5f4e-4d86-bdab-b2f99c18b796 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:30.515187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176857ab-f8aa-44e3-b4e4-da0283bd4e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.516311 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176857ab-f8aa-44e3-b4e4-da0283bd4e5b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.517346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176857ab-f8aa-44e3-b4e4-da0283bd4e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.517809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176857ab-f8aa-44e3-b4e4-da0283bd4e5b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.518462 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176857ab-f8aa-44e3-b4e4-da0283bd4e5b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.519874 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176857ab-f8aa-44e3-b4e4-da0283bd4e5b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-176857ab-f8aa-44e3-b4e4-da0283bd4e5b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:30.531553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:30.533174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:30.534011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 427/850] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:08:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:30.534817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176857ab-f8aa-44e3-b4e4-da0283bd4e5b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:30.582796 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b77f8b-5f4e-4d86-bdab-b2f99c18b796 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:30.617444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2eb15-a2d8-45d9-ac2d-e7161dcdeeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.618117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2eb15-a2d8-45d9-ac2d-e7161dcdeeef None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.618397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2eb15-a2d8-45d9-ac2d-e7161dcdeeef None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.618668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2eb15-a2d8-45d9-ac2d-e7161dcdeeef None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.619528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2eb15-a2d8-45d9-ac2d-e7161dcdeeef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:30.620265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2eb15-a2d8-45d9-ac2d-e7161dcdeeef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.621971 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2eb15-a2d8-45d9-ac2d-e7161dcdeeef None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:30.631891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176857ab-f8aa-44e3-b4e4-da0283bd4e5b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:30.640184 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 424/851] 10.222.0.64 () {56 vars in 1149 bytes} [Fri May 13 17:08:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:30.641016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2eb15-a2d8-45d9-ac2d-e7161dcdeeef None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:30.669891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7d706-d31e-4d99-9b15-cf8d4e7829ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.670621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7d706-d31e-4d99-9b15-cf8d4e7829ed None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.670910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7d706-d31e-4d99-9b15-cf8d4e7829ed None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.671221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7d706-d31e-4d99-9b15-cf8d4e7829ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.739719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7d706-d31e-4d99-9b15-cf8d4e7829ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.741228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7d706-d31e-4d99-9b15-cf8d4e7829ed None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:30.742132 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2eb15-a2d8-45d9-ac2d-e7161dcdeeef None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:30.777352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25862fc-bebb-4f58-913e-4716470a2b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.778023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25862fc-bebb-4f58-913e-4716470a2b3a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.778307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25862fc-bebb-4f58-913e-4716470a2b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.778584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25862fc-bebb-4f58-913e-4716470a2b3a None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.779326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25862fc-bebb-4f58-913e-4716470a2b3a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:30.779634 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25862fc-bebb-4f58-913e-4716470a2b3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.781010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25862fc-bebb-4f58-913e-4716470a2b3a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:30.786087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 425/852] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:08:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:30.786580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25862fc-bebb-4f58-913e-4716470a2b3a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:30.845693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 428/853] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:08:30.847235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7d706-d31e-4d99-9b15-cf8d4e7829ed None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:30.886924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25862fc-bebb-4f58-913e-4716470a2b3a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:30.919806 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120fc60-c09e-483a-8b2c-07b01bb0e876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.920451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120fc60-c09e-483a-8b2c-07b01bb0e876 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.920734 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120fc60-c09e-483a-8b2c-07b01bb0e876 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.921010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120fc60-c09e-483a-8b2c-07b01bb0e876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.945792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7d706-d31e-4d99-9b15-cf8d4e7829ed None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:30.979940 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf69d9-da9f-4859-8a59-280a0da2df65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:30.980610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf69d9-da9f-4859-8a59-280a0da2df65 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:30.980957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf69d9-da9f-4859-8a59-280a0da2df65 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:30.981292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf69d9-da9f-4859-8a59-280a0da2df65 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:30.981996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf69d9-da9f-4859-8a59-280a0da2df65 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:30.982303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf69d9-da9f-4859-8a59-280a0da2df65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.983722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf69d9-da9f-4859-8a59-280a0da2df65 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:30.991672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 429/854] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:08:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:30.992255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf69d9-da9f-4859-8a59-280a0da2df65 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:30.993567 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120fc60-c09e-483a-8b2c-07b01bb0e876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:30.995098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120fc60-c09e-483a-8b2c-07b01bb0e876 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:31.117220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 426/855] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:08:31.119988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120fc60-c09e-483a-8b2c-07b01bb0e876 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:31.131454 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf69d9-da9f-4859-8a59-280a0da2df65 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:31.173270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275666b-ba99-4c0b-b870-49f2b687c7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:31.174452 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275666b-ba99-4c0b-b870-49f2b687c7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:31.174946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275666b-ba99-4c0b-b870-49f2b687c7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:31.175455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275666b-ba99-4c0b-b870-49f2b687c7b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:31.187361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275666b-ba99-4c0b-b870-49f2b687c7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:31.188883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275666b-ba99-4c0b-b870-49f2b687c7b7 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d275666b-ba99-4c0b-b870-49f2b687c7b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:31.207821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:31.208779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:31.209824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:31.209824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:31.209824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:31.209824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:31.209824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 430/856] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:31.216911 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275666b-ba99-4c0b-b870-49f2b687c7b7 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:31.238481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120fc60-c09e-483a-8b2c-07b01bb0e876 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:31.281040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c73f80-a2f6-4304-b3a7-4d465675ffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:31.282000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c73f80-a2f6-4304-b3a7-4d465675ffe6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:31.282774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c73f80-a2f6-4304-b3a7-4d465675ffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:31.283066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c73f80-a2f6-4304-b3a7-4d465675ffe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:31.295276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c73f80-a2f6-4304-b3a7-4d465675ffe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:31.296937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c73f80-a2f6-4304-b3a7-4d465675ffe6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-36c73f80-a2f6-4304-b3a7-4d465675ffe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:31.323828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:31.325026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:31.326343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:31.326343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:31.326343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:31.326343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:31.326343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 427/857] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:31.332381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275666b-ba99-4c0b-b870-49f2b687c7b7 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:31.333253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c73f80-a2f6-4304-b3a7-4d465675ffe6 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:31.378282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ecc6c-5a1b-443a-b075-ce4b0dc22714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:31.378892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ecc6c-5a1b-443a-b075-ce4b0dc22714 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:31.379212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ecc6c-5a1b-443a-b075-ce4b0dc22714 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:31.379785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ecc6c-5a1b-443a-b075-ce4b0dc22714 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:31.380559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ecc6c-5a1b-443a-b075-ce4b0dc22714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:31.381127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ecc6c-5a1b-443a-b075-ce4b0dc22714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:31.382703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ecc6c-5a1b-443a-b075-ce4b0dc22714 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:31.399160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 431/858] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:31.404087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ecc6c-5a1b-443a-b075-ce4b0dc22714 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:31.446214 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c73f80-a2f6-4304-b3a7-4d465675ffe6 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:31.490920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaeaa85-a16c-4741-9f3e-9ad6d8c3a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:31.492040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeaa85-a16c-4741-9f3e-9ad6d8c3a157 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:31.492478 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeaa85-a16c-4741-9f3e-9ad6d8c3a157 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:31.493190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeaa85-a16c-4741-9f3e-9ad6d8c3a157 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:31.494078 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeaa85-a16c-4741-9f3e-9ad6d8c3a157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:31.494536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeaa85-a16c-4741-9f3e-9ad6d8c3a157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:31.496557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeaa85-a16c-4741-9f3e-9ad6d8c3a157 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:31.508023 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ecc6c-5a1b-443a-b075-ce4b0dc22714 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:31.512405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 428/859] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:31.520789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaeaa85-a16c-4741-9f3e-9ad6d8c3a157 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:31.554052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3a0c9-5944-424a-ab1d-39000420f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:31.555726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3a0c9-5944-424a-ab1d-39000420f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:31.556221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3a0c9-5944-424a-ab1d-39000420f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:31.556695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3a0c9-5944-424a-ab1d-39000420f7b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:31.568103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3a0c9-5944-424a-ab1d-39000420f7b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:31.569572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3a0c9-5944-424a-ab1d-39000420f7b1 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-b9a3a0c9-5944-424a-ab1d-39000420f7b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:31.584267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:31.585231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:31.586236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:31.586236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:31.586236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:31.586236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:31.586236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:31.586236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:31.586236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:31.586236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:31.590213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 432/860] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:31.591525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3a0c9-5944-424a-ab1d-39000420f7b1 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:31.639649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaeaa85-a16c-4741-9f3e-9ad6d8c3a157 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:31.684011 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62089ddd-6f28-4414-9158-ea8b6d7fb3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:31.685631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62089ddd-6f28-4414-9158-ea8b6d7fb3cc None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:31.686401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62089ddd-6f28-4414-9158-ea8b6d7fb3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:31.686902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62089ddd-6f28-4414-9158-ea8b6d7fb3cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:31.692309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3a0c9-5944-424a-ab1d-39000420f7b1 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:31.697481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62089ddd-6f28-4414-9158-ea8b6d7fb3cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:31.699023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62089ddd-6f28-4414-9158-ea8b6d7fb3cc None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-62089ddd-6f28-4414-9158-ea8b6d7fb3cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:31.713898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:31.714880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:31.715801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:31.715801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:31.715801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:31.715801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:31.715801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:31.715801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:31.715801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:31.715801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:31.720554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 429/861] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:31.722033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62089ddd-6f28-4414-9158-ea8b6d7fb3cc None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:31.734813 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20056338-29a5-4eec-b604-9cc6c70ac5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:31.736658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20056338-29a5-4eec-b604-9cc6c70ac5cb None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:31.737129 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20056338-29a5-4eec-b604-9cc6c70ac5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:31.737743 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20056338-29a5-4eec-b604-9cc6c70ac5cb None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:31.739149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20056338-29a5-4eec-b604-9cc6c70ac5cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:31.739941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20056338-29a5-4eec-b604-9cc6c70ac5cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:31.742053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20056338-29a5-4eec-b604-9cc6c70ac5cb None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:31.757528 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 433/862] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:31.764130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20056338-29a5-4eec-b604-9cc6c70ac5cb None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:31.841758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62089ddd-6f28-4414-9158-ea8b6d7fb3cc None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:31.877939 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b7532-8b95-4467-8984-c3942970298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:31.878942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b7532-8b95-4467-8984-c3942970298b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:31.879283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20056338-29a5-4eec-b604-9cc6c70ac5cb None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:31.879995 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b7532-8b95-4467-8984-c3942970298b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:31.880465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b7532-8b95-4467-8984-c3942970298b None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:31.881467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b7532-8b95-4467-8984-c3942970298b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:31.881974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b7532-8b95-4467-8984-c3942970298b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:31.883695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b7532-8b95-4467-8984-c3942970298b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:31.896233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 430/863] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:31.902627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b7532-8b95-4467-8984-c3942970298b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:31.921505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6a1e2-a1c8-4498-a92a-f95cc4220891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:31.922165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6a1e2-a1c8-4498-a92a-f95cc4220891 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:31.922448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6a1e2-a1c8-4498-a92a-f95cc4220891 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:31.922729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6a1e2-a1c8-4498-a92a-f95cc4220891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:31.924452 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6a1e2-a1c8-4498-a92a-f95cc4220891 None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=973cc524d553428aa2b2763ce28cc920) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:31.924776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6a1e2-a1c8-4498-a92a-f95cc4220891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:31.926625 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6a1e2-a1c8-4498-a92a-f95cc4220891 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:31.939179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 434/864] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:31 2022] GET /identity/v3/role_assignments?user.id=973cc524d553428aa2b2763ce28cc920&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=2791519d9bad43318f086666b6e64a20 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:32.025124 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b7532-8b95-4467-8984-c3942970298b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:32.064454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b09344-ec9e-4c28-afff-7950f8551699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:32.065128 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b09344-ec9e-4c28-afff-7950f8551699 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:32.065415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b09344-ec9e-4c28-afff-7950f8551699 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:32.065694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b09344-ec9e-4c28-afff-7950f8551699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:32.066538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b09344-ec9e-4c28-afff-7950f8551699 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=762c7aace59a4d02bf76f1e59bb21f0e) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:32.066853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b09344-ec9e-4c28-afff-7950f8551699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:32.068370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b09344-ec9e-4c28-afff-7950f8551699 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:32.075727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 431/865] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:31 2022] GET /identity/v3/role_assignments?user.id=762c7aace59a4d02bf76f1e59bb21f0e&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:32.176501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1401-5dc7-40c6-bc32-7bd9cd077da2 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:32.176700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1401-5dc7-40c6-bc32-7bd9cd077da2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:32.176984 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1401-5dc7-40c6-bc32-7bd9cd077da2 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:32.178560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 435/866] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:32.184440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29508bc0-b4e8-4534-a113-6eab60d57cc1 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:32.185069 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29508bc0-b4e8-4534-a113-6eab60d57cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:32.185577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29508bc0-b4e8-4534-a113-6eab60d57cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:32.204201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-29508bc0-b4e8-4534-a113-6eab60d57cc1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:32.205818 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-29508bc0-b4e8-4534-a113-6eab60d57cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:32.280429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 432/867] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:32.303734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec1401-5dc7-40c6-bc32-7bd9cd077da2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:32.411466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec1401-5dc7-40c6-bc32-7bd9cd077da2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:32.444527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8db48-9607-43e0-9cee-76b0bc93380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:32.445259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8db48-9607-43e0-9cee-76b0bc93380a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:32.445537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8db48-9607-43e0-9cee-76b0bc93380a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:32.445806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8db48-9607-43e0-9cee-76b0bc93380a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:32.446448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8db48-9607-43e0-9cee-76b0bc93380a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:32.447859 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8db48-9607-43e0-9cee-76b0bc93380a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-06f8db48-9607-43e0-9cee-76b0bc93380a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:32.460112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:32.461142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:32.462065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 436/868] 10.222.0.64 () {56 vars in 1132 bytes} [Fri May 13 17:08:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:32.471937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29508bc0-b4e8-4534-a113-6eab60d57cc1 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:32.570538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29508bc0-b4e8-4534-a113-6eab60d57cc1 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:32.606575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7349aa-fcfb-43dd-ad11-6882c30c159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:32.607684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7349aa-fcfb-43dd-ad11-6882c30c159c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:32.608193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7349aa-fcfb-43dd-ad11-6882c30c159c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:32.608687 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7349aa-fcfb-43dd-ad11-6882c30c159c None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:32.609614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7349aa-fcfb-43dd-ad11-6882c30c159c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:32.610136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7349aa-fcfb-43dd-ad11-6882c30c159c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:32.612334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7349aa-fcfb-43dd-ad11-6882c30c159c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:32.617643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 433/869] 10.222.0.64 () {56 vars in 1126 bytes} [Fri May 13 17:08:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:32.623413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8db48-9607-43e0-9cee-76b0bc93380a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:32.725992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8db48-9607-43e0-9cee-76b0bc93380a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:32.762970 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7b135-2472-48c8-ad57-20e82f613de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:32.764072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7b135-2472-48c8-ad57-20e82f613de7 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:32.764571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7b135-2472-48c8-ad57-20e82f613de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:32.765056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7b135-2472-48c8-ad57-20e82f613de7 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:32.765968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7b135-2472-48c8-ad57-20e82f613de7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:32.766486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7b135-2472-48c8-ad57-20e82f613de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:32.768163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7b135-2472-48c8-ad57-20e82f613de7 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:32.773424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 437/870] 10.222.0.64 () {56 vars in 1126 bytes} [Fri May 13 17:08:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:33.281819 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be09ba-e937-43a8-92dd-277e28f0573e None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:33.282892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be09ba-e937-43a8-92dd-277e28f0573e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:33.282892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be09ba-e937-43a8-92dd-277e28f0573e None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:33.284378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 434/871] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:33.289963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512ddb2-652a-4368-9c27-af1c466fa9b7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:33.290377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512ddb2-652a-4368-9c27-af1c466fa9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:33.290562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512ddb2-652a-4368-9c27-af1c466fa9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:33.307419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8512ddb2-652a-4368-9c27-af1c466fa9b7 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:33.308599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8512ddb2-652a-4368-9c27-af1c466fa9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:33.388981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 438/872] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:33.410907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be09ba-e937-43a8-92dd-277e28f0573e None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:33.512246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be09ba-e937-43a8-92dd-277e28f0573e None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:33.546062 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c6374-e13f-4def-b58d-9100d14e7865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:33.547081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c6374-e13f-4def-b58d-9100d14e7865 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:33.547612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c6374-e13f-4def-b58d-9100d14e7865 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:33.548631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c6374-e13f-4def-b58d-9100d14e7865 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:33.549570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c6374-e13f-4def-b58d-9100d14e7865 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:33.551248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c6374-e13f-4def-b58d-9100d14e7865 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:33.628326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 435/873] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:08:33 2022] POST /identity/v3/services => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:34.264540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b31fb-77a1-49c3-a8c8-550f552e4507 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:34.264904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b31fb-77a1-49c3-a8c8-550f552e4507 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:34.265040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b31fb-77a1-49c3-a8c8-550f552e4507 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:34.266632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 439/874] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:34.272116 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8091-6b1e-4a69-bd24-f0321e31e264 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:34.272408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8091-6b1e-4a69-bd24-f0321e31e264 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:34.272691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8091-6b1e-4a69-bd24-f0321e31e264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:34.290957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c5dc8091-6b1e-4a69-bd24-f0321e31e264 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:34.293055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c5dc8091-6b1e-4a69-bd24-f0321e31e264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:34.370032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 436/875] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:34.395035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b31fb-77a1-49c3-a8c8-550f552e4507 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:34.475523 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28aa29-60fb-47e0-84c3-d4367518cc11 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:34.476189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28aa29-60fb-47e0-84c3-d4367518cc11 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:34.476664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28aa29-60fb-47e0-84c3-d4367518cc11 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:34.479629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 437/876] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:34.483996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52cfdf-914b-4ce5-bbe2-46ed64199ebc None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:34.484516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52cfdf-914b-4ce5-bbe2-46ed64199ebc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:34.484994 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52cfdf-914b-4ce5-bbe2-46ed64199ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:34.502965 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-4b52cfdf-914b-4ce5-bbe2-46ed64199ebc None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:34.504538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-4b52cfdf-914b-4ce5-bbe2-46ed64199ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:34.513624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b31fb-77a1-49c3-a8c8-550f552e4507 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:34.547452 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa403-c55a-4878-b2b2-a02d77da26a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:34.548815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa403-c55a-4878-b2b2-a02d77da26a0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:34.549095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa403-c55a-4878-b2b2-a02d77da26a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:34.549363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa403-c55a-4878-b2b2-a02d77da26a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:34.550007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa403-c55a-4878-b2b2-a02d77da26a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:34.551399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa403-c55a-4878-b2b2-a02d77da26a0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-113aa403-c55a-4878-b2b2-a02d77da26a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:34.564645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:34.565692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:34.566566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:34.570795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 440/877] 10.222.0.64 () {56 vars in 1126 bytes} [Fri May 13 17:08:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:34.572135 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa403-c55a-4878-b2b2-a02d77da26a0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:34.580933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 438/878] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:34.604226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52cfdf-914b-4ce5-bbe2-46ed64199ebc None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:34.699815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa403-c55a-4878-b2b2-a02d77da26a0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:34.729120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52cfdf-914b-4ce5-bbe2-46ed64199ebc None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:34.733472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c56d6-a205-4769-ba54-42e97254774e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:34.734296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c56d6-a205-4769-ba54-42e97254774e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:34.734683 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c56d6-a205-4769-ba54-42e97254774e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:34.735059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c56d6-a205-4769-ba54-42e97254774e None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:34.736483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c56d6-a205-4769-ba54-42e97254774e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:34.736915 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c56d6-a205-4769-ba54-42e97254774e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:34.738409 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c56d6-a205-4769-ba54-42e97254774e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:34.748000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 441/879] 10.222.0.64 () {56 vars in 1122 bytes} [Fri May 13 17:08:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:34.750174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c56d6-a205-4769-ba54-42e97254774e None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:34.775578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a5d02-bd31-44da-80bd-6bbca1367dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:34.776697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a5d02-bd31-44da-80bd-6bbca1367dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:34.776940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a5d02-bd31-44da-80bd-6bbca1367dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:34.777316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a5d02-bd31-44da-80bd-6bbca1367dd1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:34.788246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a5d02-bd31-44da-80bd-6bbca1367dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-777a5d02-bd31-44da-80bd-6bbca1367dd1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:34.796600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:34.797811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:08:34.798878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:34.805167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 439/880] 10.222.0.64 () {56 vars in 1120 bytes} [Fri May 13 17:08:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:34.807031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a5d02-bd31-44da-80bd-6bbca1367dd1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:34.880978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c56d6-a205-4769-ba54-42e97254774e None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:34.926304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b9d44-613a-4d51-a533-2d123d5118bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:34.927265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a5d02-bd31-44da-80bd-6bbca1367dd1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:34.927622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b9d44-613a-4d51-a533-2d123d5118bf None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:34.928104 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b9d44-613a-4d51-a533-2d123d5118bf None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:34.928766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b9d44-613a-4d51-a533-2d123d5118bf None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:34.930477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b9d44-613a-4d51-a533-2d123d5118bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:34.931002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b9d44-613a-4d51-a533-2d123d5118bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:34.932642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b9d44-613a-4d51-a533-2d123d5118bf None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:34.939669 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 442/881] 10.222.0.64 () {56 vars in 1122 bytes} [Fri May 13 17:08:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:34.967828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02990ff-0c59-4e37-a66d-f315077873b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:34.968909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02990ff-0c59-4e37-a66d-f315077873b5 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:34.969398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02990ff-0c59-4e37-a66d-f315077873b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:34.969948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02990ff-0c59-4e37-a66d-f315077873b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:34.970956 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02990ff-0c59-4e37-a66d-f315077873b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:34.971515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02990ff-0c59-4e37-a66d-f315077873b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:34.973189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02990ff-0c59-4e37-a66d-f315077873b5 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:34.983171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 440/882] 10.222.0.64 () {56 vars in 1115 bytes} [Fri May 13 17:08:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:34.989014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b9d44-613a-4d51-a533-2d123d5118bf None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:35.062739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e84b-5907-4318-861f-c606cfb8e5eb None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:35.062920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e84b-5907-4318-861f-c606cfb8e5eb None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:35.063228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e84b-5907-4318-861f-c606cfb8e5eb None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:35.065691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 441/883] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:35.071474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4765-fe93-4d6e-8e67-8223cd3514d5 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:35.071810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4765-fe93-4d6e-8e67-8223cd3514d5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:35.072044 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4765-fe93-4d6e-8e67-8223cd3514d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:35.089996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-7cfc4765-fe93-4d6e-8e67-8223cd3514d5 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:35.091090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7cfc4765-fe93-4d6e-8e67-8223cd3514d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:35.106370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b9d44-613a-4d51-a533-2d123d5118bf None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:35.149122 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34874cf-0f8b-49dc-9298-5caddcba1d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:35.150201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34874cf-0f8b-49dc-9298-5caddcba1d18 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:35.150500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34874cf-0f8b-49dc-9298-5caddcba1d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:35.150779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34874cf-0f8b-49dc-9298-5caddcba1d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:35.163095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34874cf-0f8b-49dc-9298-5caddcba1d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:35.165631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34874cf-0f8b-49dc-9298-5caddcba1d18 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:35.166216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 442/884] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d34874cf-0f8b-49dc-9298-5caddcba1d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:35.185903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:35.187031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:35.188330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:35.188330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:35.188330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:35.188330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:35.188330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 443/885] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:35.190997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc4765-fe93-4d6e-8e67-8223cd3514d5 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:35.194963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34874cf-0f8b-49dc-9298-5caddcba1d18 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:35.303750 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc4765-fe93-4d6e-8e67-8223cd3514d5 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:35.312074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34874cf-0f8b-49dc-9298-5caddcba1d18 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:35.350017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42bbc2-1e0c-41c6-8eba-9435e5deb068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:35.350756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42bbc2-1e0c-41c6-8eba-9435e5deb068 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:35.351044 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42bbc2-1e0c-41c6-8eba-9435e5deb068 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:35.351343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42bbc2-1e0c-41c6-8eba-9435e5deb068 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:35.352223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42bbc2-1e0c-41c6-8eba-9435e5deb068 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:35.354573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42bbc2-1e0c-41c6-8eba-9435e5deb068 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:35.358152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409812-9b10-4672-9924-14469cda81a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:35.359329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409812-9b10-4672-9924-14469cda81a5 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:35.359497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409812-9b10-4672-9924-14469cda81a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:35.359736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409812-9b10-4672-9924-14469cda81a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:35.361076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6409812-9b10-4672-9924-14469cda81a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:35.361369 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6409812-9b10-4672-9924-14469cda81a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:35.362758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6409812-9b10-4672-9924-14469cda81a5 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:35.375014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 444/886] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:35.380142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409812-9b10-4672-9924-14469cda81a5 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:35.433365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 443/887] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:08:35 2022] POST /identity/v3/services => generated 269 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:35.487145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409812-9b10-4672-9924-14469cda81a5 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:35.531271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd28ea4-d723-4f78-8156-939b4d645f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:35.532985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd28ea4-d723-4f78-8156-939b4d645f0c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:35.533435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd28ea4-d723-4f78-8156-939b4d645f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:35.533864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd28ea4-d723-4f78-8156-939b4d645f0c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:35.542290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd28ea4-d723-4f78-8156-939b4d645f0c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:35.544103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd28ea4-d723-4f78-8156-939b4d645f0c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-1cd28ea4-d723-4f78-8156-939b4d645f0c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:35.560627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:35.561901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:35.563167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:35.563167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:35.563167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:35.563167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:35.563167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:35.563167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:35.563167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:35.563167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:35.563167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:35.563167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:35.565696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 445/888] 10.222.0.64 () {56 vars in 1117 bytes} [Fri May 13 17:08:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:35.571630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42bbc2-1e0c-41c6-8eba-9435e5deb068 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:35.680123 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42bbc2-1e0c-41c6-8eba-9435e5deb068 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:35.714361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cff3c-5963-4ea7-ade1-0fee4a7e752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:35.715064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cff3c-5963-4ea7-ade1-0fee4a7e752b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:35.715432 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cff3c-5963-4ea7-ade1-0fee4a7e752b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:35.715715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cff3c-5963-4ea7-ade1-0fee4a7e752b None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:35.716605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cff3c-5963-4ea7-ade1-0fee4a7e752b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:35.716914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cff3c-5963-4ea7-ade1-0fee4a7e752b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:35.718426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cff3c-5963-4ea7-ade1-0fee4a7e752b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:35.740013 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 444/889] 10.222.0.64 () {56 vars in 1149 bytes} [Fri May 13 17:08:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:35.745992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd28ea4-d723-4f78-8156-939b4d645f0c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:35.849356 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd28ea4-d723-4f78-8156-939b4d645f0c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:35.884269 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd0896-1029-47b3-9644-3d630f82099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:35.884920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0896-1029-47b3-9644-3d630f82099e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:35.885198 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0896-1029-47b3-9644-3d630f82099e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:35.885475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0896-1029-47b3-9644-3d630f82099e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:35.905215 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6ac2-5b9c-4a6e-86db-48d409f63d2b None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:35.905541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6ac2-5b9c-4a6e-86db-48d409f63d2b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:35.905773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6ac2-5b9c-4a6e-86db-48d409f63d2b None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:35.907967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 445/890] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:35.912744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233cd93-e2a4-461e-822f-94a58bf8c7ac None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:35.913034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233cd93-e2a4-461e-822f-94a58bf8c7ac None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:35.913314 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233cd93-e2a4-461e-822f-94a58bf8c7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:35.930047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f233cd93-e2a4-461e-822f-94a58bf8c7ac None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:35.931332 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f233cd93-e2a4-461e-822f-94a58bf8c7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:35.960895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd0896-1029-47b3-9644-3d630f82099e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:35.962381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd0896-1029-47b3-9644-3d630f82099e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:36.015306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 446/891] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:36.042539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233cd93-e2a4-461e-822f-94a58bf8c7ac None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:36.081893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 446/892] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:35 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:08:36.087165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd0896-1029-47b3-9644-3d630f82099e None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:36.156174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233cd93-e2a4-461e-822f-94a58bf8c7ac None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:36.192756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73564a65-5f5d-43f7-b45b-5ed1ae34c0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:36.193612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73564a65-5f5d-43f7-b45b-5ed1ae34c0ee None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:36.193995 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73564a65-5f5d-43f7-b45b-5ed1ae34c0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:36.194399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73564a65-5f5d-43f7-b45b-5ed1ae34c0ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:36.195170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73564a65-5f5d-43f7-b45b-5ed1ae34c0ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:36.196665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73564a65-5f5d-43f7-b45b-5ed1ae34c0ee None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:36.204967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd0896-1029-47b3-9644-3d630f82099e None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-73564a65-5f5d-43f7-b45b-5ed1ae34c0ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:36.209058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:36.210297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 17:08:36.211428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:36.212219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 447/893] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:08:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:36.220928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73564a65-5f5d-43f7-b45b-5ed1ae34c0ee None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:36.245624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2c78a-41a5-473f-8972-8d78b65476e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:36.246712 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c78a-41a5-473f-8972-8d78b65476e6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:36.246998 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c78a-41a5-473f-8972-8d78b65476e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:36.247299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c78a-41a5-473f-8972-8d78b65476e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:36.259679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2c78a-41a5-473f-8972-8d78b65476e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:36.261619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2c78a-41a5-473f-8972-8d78b65476e6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d2e2c78a-41a5-473f-8972-8d78b65476e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:36.284170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:36.285134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:36.286036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:36.286036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:36.286036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:36.286036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:36.286036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 447/894] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:36.292194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2c78a-41a5-473f-8972-8d78b65476e6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:36.337370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73564a65-5f5d-43f7-b45b-5ed1ae34c0ee None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:36.371962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8c180-41fd-4faa-b7c7-69098acfc7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:36.372392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8c180-41fd-4faa-b7c7-69098acfc7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:36.372673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8c180-41fd-4faa-b7c7-69098acfc7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:36.372947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8c180-41fd-4faa-b7c7-69098acfc7c3 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:36.373649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8c180-41fd-4faa-b7c7-69098acfc7c3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:36.373953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8c180-41fd-4faa-b7c7-69098acfc7c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:36.375356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8c180-41fd-4faa-b7c7-69098acfc7c3 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:36.380924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 448/895] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:08:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:36.385928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8c180-41fd-4faa-b7c7-69098acfc7c3 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:36.399353 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2c78a-41a5-473f-8972-8d78b65476e6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:36.433435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d73ef-de3b-413d-a7f7-0cda89481884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:36.434493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d73ef-de3b-413d-a7f7-0cda89481884 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:36.434982 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d73ef-de3b-413d-a7f7-0cda89481884 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:36.435482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d73ef-de3b-413d-a7f7-0cda89481884 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:36.436424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d73ef-de3b-413d-a7f7-0cda89481884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:36.436948 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d73ef-de3b-413d-a7f7-0cda89481884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:36.438600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d73ef-de3b-413d-a7f7-0cda89481884 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:36.455484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 448/896] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:36.456568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d73ef-de3b-413d-a7f7-0cda89481884 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:36.505064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8c180-41fd-4faa-b7c7-69098acfc7c3 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:36.545817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ee685-ba75-430c-b534-975e3f8198f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:36.546485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee685-ba75-430c-b534-975e3f8198f8 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:36.546771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee685-ba75-430c-b534-975e3f8198f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:36.547051 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee685-ba75-430c-b534-975e3f8198f8 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:36.547792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ee685-ba75-430c-b534-975e3f8198f8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:36.548629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ee685-ba75-430c-b534-975e3f8198f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:36.550437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ee685-ba75-430c-b534-975e3f8198f8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:36.559281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 449/897] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:08:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:36.562462 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ee685-ba75-430c-b534-975e3f8198f8 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:36.568106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d73ef-de3b-413d-a7f7-0cda89481884 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:36.602550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73156ccd-e45b-4a5c-83cb-fcc81d849a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:36.603773 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156ccd-e45b-4a5c-83cb-fcc81d849a7a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:36.604273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156ccd-e45b-4a5c-83cb-fcc81d849a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:36.604767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156ccd-e45b-4a5c-83cb-fcc81d849a7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:36.613455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73156ccd-e45b-4a5c-83cb-fcc81d849a7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:36.615473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73156ccd-e45b-4a5c-83cb-fcc81d849a7a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-73156ccd-e45b-4a5c-83cb-fcc81d849a7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:36.632315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:36.633283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:36.634196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:36.634196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:36.634196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:36.634196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:36.634196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:36.634196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:36.634196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:36.634196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:36.641259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 449/898] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:36.642347 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73156ccd-e45b-4a5c-83cb-fcc81d849a7a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:36.681488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ee685-ba75-430c-b534-975e3f8198f8 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:36.715804 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f8c42-629c-46d0-aaa2-77229954d47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:36.716855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f8c42-629c-46d0-aaa2-77229954d47f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:36.717348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f8c42-629c-46d0-aaa2-77229954d47f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:36.717873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f8c42-629c-46d0-aaa2-77229954d47f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:36.718873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f8c42-629c-46d0-aaa2-77229954d47f None admin] RBAC: Adding query filter params (interface=public, service_id=d7cb65c80d7940ada254b52fb1590689, region_id=RegionOne) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:36.719457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f8c42-629c-46d0-aaa2-77229954d47f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:36.721634 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f8c42-629c-46d0-aaa2-77229954d47f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:36.727579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 450/899] 10.222.0.64 () {56 vars in 1251 bytes} [Fri May 13 17:08:36 2022] GET /identity/v3/endpoints?service_id=d7cb65c80d7940ada254b52fb1590689&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:36.737091 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f8c42-629c-46d0-aaa2-77229954d47f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:36.761338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73156ccd-e45b-4a5c-83cb-fcc81d849a7a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:36.796405 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60388c1-3b17-4c48-903a-be24de11607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:36.797109 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60388c1-3b17-4c48-903a-be24de11607c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:36.797394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60388c1-3b17-4c48-903a-be24de11607c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:36.797672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60388c1-3b17-4c48-903a-be24de11607c None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:36.799024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60388c1-3b17-4c48-903a-be24de11607c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:36.799370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60388c1-3b17-4c48-903a-be24de11607c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:36.800846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60388c1-3b17-4c48-903a-be24de11607c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:36.812910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 450/900] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:36.819539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60388c1-3b17-4c48-903a-be24de11607c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:36.855071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f8c42-629c-46d0-aaa2-77229954d47f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:36.889596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f8c0d-afa6-4ee7-a406-e872bb93a7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:36.890257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8c0d-afa6-4ee7-a406-e872bb93a7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:36.890601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8c0d-afa6-4ee7-a406-e872bb93a7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:36.890885 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8c0d-afa6-4ee7-a406-e872bb93a7e0 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:36.892650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f8c0d-afa6-4ee7-a406-e872bb93a7e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:36.893571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f8c0d-afa6-4ee7-a406-e872bb93a7e0 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:36.903589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 451/901] 10.222.0.64 () {56 vars in 1087 bytes} [Fri May 13 17:08:36 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:08:36.925586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60388c1-3b17-4c48-903a-be24de11607c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:36.972266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e4186-c8b8-4f5b-842d-af85bc822194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:36.973289 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4186-c8b8-4f5b-842d-af85bc822194 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:36.973871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4186-c8b8-4f5b-842d-af85bc822194 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:36.974374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4186-c8b8-4f5b-842d-af85bc822194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:36.975460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e4186-c8b8-4f5b-842d-af85bc822194 None admin] RBAC: Adding query filter params (role.id=b1d2c3a8bfec44aeacafbdc51013fad7, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=762c7aace59a4d02bf76f1e59bb21f0e) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:36.975999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e4186-c8b8-4f5b-842d-af85bc822194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:36.977751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e4186-c8b8-4f5b-842d-af85bc822194 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:36.984926 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 451/902] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:36 2022] GET /identity/v3/role_assignments?user.id=762c7aace59a4d02bf76f1e59bb21f0e&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=b1d2c3a8bfec44aeacafbdc51013fad7 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:37.295694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa518-630c-4504-b84b-3d9a1221e775 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:37.296042 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa518-630c-4504-b84b-3d9a1221e775 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:37.296158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa518-630c-4504-b84b-3d9a1221e775 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:37.297780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 452/903] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:37.303381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0b98-127e-4456-86fc-94615653537a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:37.303667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0b98-127e-4456-86fc-94615653537a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:37.303944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0b98-127e-4456-86fc-94615653537a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:37.321086 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-515d0b98-127e-4456-86fc-94615653537a None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:37.322320 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-515d0b98-127e-4456-86fc-94615653537a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:37.400409 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 452/904] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:37.423913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aa518-630c-4504-b84b-3d9a1221e775 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:37.528233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aa518-630c-4504-b84b-3d9a1221e775 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:37.564173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1beb85-97df-4298-a74d-103f37119d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:37.564779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1beb85-97df-4298-a74d-103f37119d94 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:37.565064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1beb85-97df-4298-a74d-103f37119d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:37.565343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1beb85-97df-4298-a74d-103f37119d94 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:37.566103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1beb85-97df-4298-a74d-103f37119d94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:37.567568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1beb85-97df-4298-a74d-103f37119d94 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:37.635823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 453/905] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:08:37 2022] POST /identity/v3/services => generated 241 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:37.761069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd02c3-2697-47d5-a2b8-c2d2e4329297 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:37.761632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd02c3-2697-47d5-a2b8-c2d2e4329297 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:37.761632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd02c3-2697-47d5-a2b8-c2d2e4329297 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:37.763323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 453/906] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:37.769600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6056e2-9d71-4668-8c75-cd7b9fc69fd2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:37.769895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6056e2-9d71-4668-8c75-cd7b9fc69fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:37.770176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6056e2-9d71-4668-8c75-cd7b9fc69fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:37.788387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-7f6056e2-9d71-4668-8c75-cd7b9fc69fd2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:37.789629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7f6056e2-9d71-4668-8c75-cd7b9fc69fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:37.869580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 454/907] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:37.893740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd02c3-2697-47d5-a2b8-c2d2e4329297 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:37.993548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd02c3-2697-47d5-a2b8-c2d2e4329297 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:38.026994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e906b-8518-4b4e-afb2-c3bcb52687ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:38.027832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e906b-8518-4b4e-afb2-c3bcb52687ba None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:38.028111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e906b-8518-4b4e-afb2-c3bcb52687ba None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:38.028383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e906b-8518-4b4e-afb2-c3bcb52687ba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:38.029035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e906b-8518-4b4e-afb2-c3bcb52687ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:38.030433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e906b-8518-4b4e-afb2-c3bcb52687ba None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-292e906b-8518-4b4e-afb2-c3bcb52687ba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:38.042550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:38.043542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:38.044385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 454/908] 10.222.0.64 () {56 vars in 1132 bytes} [Fri May 13 17:08:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:38.052474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6056e2-9d71-4668-8c75-cd7b9fc69fd2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:38.151994 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6056e2-9d71-4668-8c75-cd7b9fc69fd2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:38.186030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdeba3-f775-4441-8458-9d75a92be4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:38.186736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdeba3-f775-4441-8458-9d75a92be4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:38.187023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdeba3-f775-4441-8458-9d75a92be4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:38.187325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdeba3-f775-4441-8458-9d75a92be4b9 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:38.188037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdeba3-f775-4441-8458-9d75a92be4b9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:38.188342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdeba3-f775-4441-8458-9d75a92be4b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:38.190421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdeba3-f775-4441-8458-9d75a92be4b9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:38.195582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 455/909] 10.222.0.64 () {56 vars in 1126 bytes} [Fri May 13 17:08:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:38.201503 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e906b-8518-4b4e-afb2-c3bcb52687ba None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:38.309523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e906b-8518-4b4e-afb2-c3bcb52687ba None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:38.343753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e9491-8902-4cb1-933f-ec4c19447a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:38.345300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e9491-8902-4cb1-933f-ec4c19447a61 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:38.345815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e9491-8902-4cb1-933f-ec4c19447a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:38.346307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e9491-8902-4cb1-933f-ec4c19447a61 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:38.347269 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e9491-8902-4cb1-933f-ec4c19447a61 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:38.347805 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e9491-8902-4cb1-933f-ec4c19447a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:38.349404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e9491-8902-4cb1-933f-ec4c19447a61 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:38.354754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 455/910] 10.222.0.64 () {56 vars in 1126 bytes} [Fri May 13 17:08:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:38.360975 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdeba3-f775-4441-8458-9d75a92be4b9 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:38.457635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdeba3-f775-4441-8458-9d75a92be4b9 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:38.498853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a21e5d-565e-4797-b8c4-f5976c242bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:38.499590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a21e5d-565e-4797-b8c4-f5976c242bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:38.499871 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a21e5d-565e-4797-b8c4-f5976c242bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:38.500145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a21e5d-565e-4797-b8c4-f5976c242bc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:38.500954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a21e5d-565e-4797-b8c4-f5976c242bc6 None admin] RBAC: Adding query filter params (interface=public, service_id=802c2f7f0a2f4c74811f7f7032eca94f, region_id=RegionOne) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:38.501266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a21e5d-565e-4797-b8c4-f5976c242bc6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:38.502645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a21e5d-565e-4797-b8c4-f5976c242bc6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:38.508200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 456/911] 10.222.0.64 () {56 vars in 1251 bytes} [Fri May 13 17:08:38 2022] GET /identity/v3/endpoints?service_id=802c2f7f0a2f4c74811f7f7032eca94f&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:38.513364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e9491-8902-4cb1-933f-ec4c19447a61 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:38.617170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e9491-8902-4cb1-933f-ec4c19447a61 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:38.651372 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763dea2-e67d-4505-a3c3-d6a4b5a11d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:38.652353 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763dea2-e67d-4505-a3c3-d6a4b5a11d54 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:38.652842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763dea2-e67d-4505-a3c3-d6a4b5a11d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:38.653318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763dea2-e67d-4505-a3c3-d6a4b5a11d54 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:38.654222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763dea2-e67d-4505-a3c3-d6a4b5a11d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:38.655840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763dea2-e67d-4505-a3c3-d6a4b5a11d54 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:38.662889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 456/912] 10.222.0.64 () {56 vars in 1087 bytes} [Fri May 13 17:08:38 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:08:39.218058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619de0-db9d-4aea-85b4-843bff42e382 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:39.218461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619de0-db9d-4aea-85b4-843bff42e382 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:39.218658 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619de0-db9d-4aea-85b4-843bff42e382 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:39.220898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 457/913] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:39.226245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d69cf8-e4af-43cd-9782-7b3a12659229 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:39.226691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d69cf8-e4af-43cd-9782-7b3a12659229 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:39.226859 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d69cf8-e4af-43cd-9782-7b3a12659229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:39.244351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c9d69cf8-e4af-43cd-9782-7b3a12659229 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:39.245473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c9d69cf8-e4af-43cd-9782-7b3a12659229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:39.311473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 457/914] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:39.334638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25619de0-db9d-4aea-85b4-843bff42e382 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:39.402500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5cb84-5554-49bb-9a50-5dee241520c6 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:39.402840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5cb84-5554-49bb-9a50-5dee241520c6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:39.403058 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5cb84-5554-49bb-9a50-5dee241520c6 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:39.404710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 458/915] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:39.409805 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad45d3-6a7c-47aa-be73-55011a762e25 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:39.410087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad45d3-6a7c-47aa-be73-55011a762e25 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:39.410361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad45d3-6a7c-47aa-be73-55011a762e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:39.428122 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-bdad45d3-6a7c-47aa-be73-55011a762e25 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:39.429304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bdad45d3-6a7c-47aa-be73-55011a762e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:39.448778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25619de0-db9d-4aea-85b4-843bff42e382 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:39.483653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ff7d4-bb82-48e9-a1d6-7baa7794a2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:39.484506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ff7d4-bb82-48e9-a1d6-7baa7794a2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:39.484953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ff7d4-bb82-48e9-a1d6-7baa7794a2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:39.485934 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ff7d4-bb82-48e9-a1d6-7baa7794a2c4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:39.486772 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ff7d4-bb82-48e9-a1d6-7baa7794a2c4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:39.488411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ff7d4-bb82-48e9-a1d6-7baa7794a2c4 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-668ff7d4-bb82-48e9-a1d6-7baa7794a2c4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:39.501733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:39.502955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 17:08:39.504022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:39.512603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 459/916] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:39.512755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 458/917] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:08:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:39.513779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad45d3-6a7c-47aa-be73-55011a762e25 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:39.529431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ff7d4-bb82-48e9-a1d6-7baa7794a2c4 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:39.613294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad45d3-6a7c-47aa-be73-55011a762e25 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:39.632165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ff7d4-bb82-48e9-a1d6-7baa7794a2c4 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:39.647778 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb1cc7-6dcf-4dc0-b72f-cdb0d618332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:39.648446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb1cc7-6dcf-4dc0-b72f-cdb0d618332e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:39.648728 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb1cc7-6dcf-4dc0-b72f-cdb0d618332e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:39.649003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb1cc7-6dcf-4dc0-b72f-cdb0d618332e None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:39.649737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb1cc7-6dcf-4dc0-b72f-cdb0d618332e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:39.650004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb1cc7-6dcf-4dc0-b72f-cdb0d618332e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:39.651425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb1cc7-6dcf-4dc0-b72f-cdb0d618332e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:39.656515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 460/918] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:08:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:39.662032 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb1cc7-6dcf-4dc0-b72f-cdb0d618332e None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:39.671908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55aa31-0184-4e0a-989f-86237af7be0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:39.673643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55aa31-0184-4e0a-989f-86237af7be0b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:39.674132 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55aa31-0184-4e0a-989f-86237af7be0b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:39.674625 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55aa31-0184-4e0a-989f-86237af7be0b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:39.685327 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55aa31-0184-4e0a-989f-86237af7be0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-8b55aa31-0184-4e0a-989f-86237af7be0b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:39.693999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:39.694950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:08:39.695833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:39.703335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 459/919] 10.222.0.64 () {56 vars in 1120 bytes} [Fri May 13 17:08:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:39.704814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55aa31-0184-4e0a-989f-86237af7be0b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:39.762504 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb1cc7-6dcf-4dc0-b72f-cdb0d618332e None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:39.797165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e12ee7-abc9-4132-8024-bd3902aa4863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:39.798412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e12ee7-abc9-4132-8024-bd3902aa4863 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:39.798702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e12ee7-abc9-4132-8024-bd3902aa4863 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:39.798972 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e12ee7-abc9-4132-8024-bd3902aa4863 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:39.799910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e12ee7-abc9-4132-8024-bd3902aa4863 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:39.800028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e12ee7-abc9-4132-8024-bd3902aa4863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:39.801449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e12ee7-abc9-4132-8024-bd3902aa4863 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:39.810146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55aa31-0184-4e0a-989f-86237af7be0b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:39.811532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 461/920] 10.222.0.64 () {56 vars in 1114 bytes} [Fri May 13 17:08:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:39.813049 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e12ee7-abc9-4132-8024-bd3902aa4863 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:39.846582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c244e9-1e06-44fe-b028-ae34af64a13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:39.847739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c244e9-1e06-44fe-b028-ae34af64a13f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:39.849261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c244e9-1e06-44fe-b028-ae34af64a13f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:39.849771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c244e9-1e06-44fe-b028-ae34af64a13f None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:39.850761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c244e9-1e06-44fe-b028-ae34af64a13f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:39.851377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c244e9-1e06-44fe-b028-ae34af64a13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:39.853100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c244e9-1e06-44fe-b028-ae34af64a13f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:39.868211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 460/921] 10.222.0.64 () {56 vars in 1115 bytes} [Fri May 13 17:08:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:39.870034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c244e9-1e06-44fe-b028-ae34af64a13f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:39.917389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e12ee7-abc9-4132-8024-bd3902aa4863 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:39.965381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebeaf5-631a-4ba2-890c-d9bdc18b5672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:39.966073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebeaf5-631a-4ba2-890c-d9bdc18b5672 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:39.966348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebeaf5-631a-4ba2-890c-d9bdc18b5672 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:39.966616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebeaf5-631a-4ba2-890c-d9bdc18b5672 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:39.967717 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebeaf5-631a-4ba2-890c-d9bdc18b5672 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:39.968949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebeaf5-631a-4ba2-890c-d9bdc18b5672 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:39.982090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c244e9-1e06-44fe-b028-ae34af64a13f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:40.017707 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b6c0-dc55-481b-937b-727e85b86539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:40.018437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b6c0-dc55-481b-937b-727e85b86539 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.018756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b6c0-dc55-481b-937b-727e85b86539 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.019040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b6c0-dc55-481b-937b-727e85b86539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.029769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b6c0-dc55-481b-937b-727e85b86539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:40.031370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b6c0-dc55-481b-937b-727e85b86539 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-be13b6c0-dc55-481b-937b-727e85b86539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:40.048834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:40.049741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:40.050630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:40.050630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:40.050630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:40.050630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:40.054374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 461/922] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:40.055885 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2a46a-c504-462b-8cc7-461aa5e635b5 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.056180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2a46a-c504-462b-8cc7-461aa5e635b5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.056460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2a46a-c504-462b-8cc7-461aa5e635b5 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.058796 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 462/923] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:40.058796 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2a46a-c504-462b-8cc7-461aa5e635b5 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:40.063108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 462/924] 10.222.0.64 () {60 vars in 1144 bytes} [Fri May 13 17:08:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:40.064455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67040ed-e53e-4c70-87d8-3eb1b6408f24 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.064739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67040ed-e53e-4c70-87d8-3eb1b6408f24 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.065004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67040ed-e53e-4c70-87d8-3eb1b6408f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.095315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b67040ed-e53e-4c70-87d8-3eb1b6408f24 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:40.097293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b67040ed-e53e-4c70-87d8-3eb1b6408f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:40.196286 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2a46a-c504-462b-8cc7-461aa5e635b5 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:40.200891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 463/925] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:40.223501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67040ed-e53e-4c70-87d8-3eb1b6408f24 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:40.237541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40e8ff-348d-4788-9443-6e97aa81080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:40.238591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e8ff-348d-4788-9443-6e97aa81080b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.239083 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e8ff-348d-4788-9443-6e97aa81080b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.239616 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e8ff-348d-4788-9443-6e97aa81080b None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.240604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40e8ff-348d-4788-9443-6e97aa81080b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:40.241135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40e8ff-348d-4788-9443-6e97aa81080b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:40.242760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40e8ff-348d-4788-9443-6e97aa81080b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:40.255571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 463/926] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:40.261237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40e8ff-348d-4788-9443-6e97aa81080b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:40.328246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67040ed-e53e-4c70-87d8-3eb1b6408f24 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:40.364843 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40e8ff-348d-4788-9443-6e97aa81080b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:40.372828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660e846-7809-4416-b6b4-68f2f6f3a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:40.373649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660e846-7809-4416-b6b4-68f2f6f3a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.373935 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660e846-7809-4416-b6b4-68f2f6f3a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.374213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660e846-7809-4416-b6b4-68f2f6f3a4a8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.375276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660e846-7809-4416-b6b4-68f2f6f3a4a8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:40.377789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660e846-7809-4416-b6b4-68f2f6f3a4a8 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-9660e846-7809-4416-b6b4-68f2f6f3a4a8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:40.393766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:40.395062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:40.396132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 464/927] 10.222.0.64 () {56 vars in 1126 bytes} [Fri May 13 17:08:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:40.403363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660e846-7809-4416-b6b4-68f2f6f3a4a8 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:40.405965 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a92a8-10bb-4910-841f-d0e0e9878c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:40.406948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a92a8-10bb-4910-841f-d0e0e9878c06 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.407979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a92a8-10bb-4910-841f-d0e0e9878c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.408402 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a92a8-10bb-4910-841f-d0e0e9878c06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.416883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a92a8-10bb-4910-841f-d0e0e9878c06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:40.419413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a92a8-10bb-4910-841f-d0e0e9878c06 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-075a92a8-10bb-4910-841f-d0e0e9878c06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:40.436554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:40.437706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:40.438831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:40.438831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:40.438831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:40.438831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:40.438831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:40.438831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:40.438831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:40.438831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:40.438831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:40.438831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:40.441057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 464/928] 10.222.0.64 () {56 vars in 1117 bytes} [Fri May 13 17:08:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:40.446893 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a92a8-10bb-4910-841f-d0e0e9878c06 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:40.528791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660e846-7809-4416-b6b4-68f2f6f3a4a8 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:40.563423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce12e7c-b149-4694-80ee-bf69c8759c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:40.564139 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12e7c-b149-4694-80ee-bf69c8759c30 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.564420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12e7c-b149-4694-80ee-bf69c8759c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.564687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12e7c-b149-4694-80ee-bf69c8759c30 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.565722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce12e7c-b149-4694-80ee-bf69c8759c30 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:40.566279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce12e7c-b149-4694-80ee-bf69c8759c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:40.567700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce12e7c-b149-4694-80ee-bf69c8759c30 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:40.568481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a92a8-10bb-4910-841f-d0e0e9878c06 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:40.579269 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 465/929] 10.222.0.64 () {56 vars in 1122 bytes} [Fri May 13 17:08:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:40.582040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce12e7c-b149-4694-80ee-bf69c8759c30 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:40.611634 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226f170-a2b4-4dce-9540-3c0dae1220a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:40.612371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226f170-a2b4-4dce-9540-3c0dae1220a6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.612659 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226f170-a2b4-4dce-9540-3c0dae1220a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.612937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226f170-a2b4-4dce-9540-3c0dae1220a6 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.613954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226f170-a2b4-4dce-9540-3c0dae1220a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:40.614264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226f170-a2b4-4dce-9540-3c0dae1220a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:40.616489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226f170-a2b4-4dce-9540-3c0dae1220a6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:40.639166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 465/930] 10.222.0.64 () {56 vars in 1149 bytes} [Fri May 13 17:08:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:40.644494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226f170-a2b4-4dce-9540-3c0dae1220a6 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:40.704923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce12e7c-b149-4694-80ee-bf69c8759c30 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:40.745930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c3faa-abb6-4b73-aca3-2f676c8a4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:40.746912 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c3faa-abb6-4b73-aca3-2f676c8a4ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.747219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c3faa-abb6-4b73-aca3-2f676c8a4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.747495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c3faa-abb6-4b73-aca3-2f676c8a4ea6 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.748429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c3faa-abb6-4b73-aca3-2f676c8a4ea6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:40.748734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c3faa-abb6-4b73-aca3-2f676c8a4ea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:40.751059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c3faa-abb6-4b73-aca3-2f676c8a4ea6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:40.759326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 466/931] 10.222.0.64 () {56 vars in 1122 bytes} [Fri May 13 17:08:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:40.764512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c3faa-abb6-4b73-aca3-2f676c8a4ea6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:40.776050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226f170-a2b4-4dce-9540-3c0dae1220a6 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:40.812530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83597831-940f-4c50-b8ab-4e429c9c8726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:40.813043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597831-940f-4c50-b8ab-4e429c9c8726 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.813460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597831-940f-4c50-b8ab-4e429c9c8726 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.813835 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597831-940f-4c50-b8ab-4e429c9c8726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.823945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83597831-940f-4c50-b8ab-4e429c9c8726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:40.825811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83597831-940f-4c50-b8ab-4e429c9c8726 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-83597831-940f-4c50-b8ab-4e429c9c8726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:40.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:40.846743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:40.847863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:40.847863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:40.847863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:40.847863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:40.853672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 466/932] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:40.854746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83597831-940f-4c50-b8ab-4e429c9c8726 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:40.896467 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c3faa-abb6-4b73-aca3-2f676c8a4ea6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:40.941873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f2f99-8ae7-4243-b0ac-72bafc0869f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:40.942538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2f99-8ae7-4243-b0ac-72bafc0869f5 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.942824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2f99-8ae7-4243-b0ac-72bafc0869f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.943102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2f99-8ae7-4243-b0ac-72bafc0869f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.943918 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f2f99-8ae7-4243-b0ac-72bafc0869f5 None admin] RBAC: Adding query filter params (interface=public, service_id=bcd30e98cfb94b2e9f8c7aaaf1447bde, region_id=RegionOne) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:40.944230 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f2f99-8ae7-4243-b0ac-72bafc0869f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:40.945622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f2f99-8ae7-4243-b0ac-72bafc0869f5 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:40.950897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 467/933] 10.222.0.64 () {56 vars in 1251 bytes} [Fri May 13 17:08:40 2022] GET /identity/v3/endpoints?service_id=bcd30e98cfb94b2e9f8c7aaaf1447bde&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:40.952157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0221-f51a-4a3e-aacc-1bdffc98fe0b None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:40.952584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0221-f51a-4a3e-aacc-1bdffc98fe0b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:40.952870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0221-f51a-4a3e-aacc-1bdffc98fe0b None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:40.954370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 468/934] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:40.961057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a0221-f51a-4a3e-aacc-1bdffc98fe0b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:40.962195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83597831-940f-4c50-b8ab-4e429c9c8726 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:41.000553 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073b8ce-d684-46a6-881b-36195fb1caf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:41.001784 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073b8ce-d684-46a6-881b-36195fb1caf0 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:41.002065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073b8ce-d684-46a6-881b-36195fb1caf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:41.002339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073b8ce-d684-46a6-881b-36195fb1caf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:41.003056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073b8ce-d684-46a6-881b-36195fb1caf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:41.003394 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073b8ce-d684-46a6-881b-36195fb1caf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:41.004774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073b8ce-d684-46a6-881b-36195fb1caf0 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:41.016557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 467/935] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:41.018078 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692155ec-459c-4f48-85bc-cb70c031a5ae None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:41.018369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692155ec-459c-4f48-85bc-cb70c031a5ae None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:41.018649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692155ec-459c-4f48-85bc-cb70c031a5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:41.035033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-692155ec-459c-4f48-85bc-cb70c031a5ae None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:41.037191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-692155ec-459c-4f48-85bc-cb70c031a5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:41.069194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a0221-f51a-4a3e-aacc-1bdffc98fe0b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:41.102226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 468/936] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:41.102894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3457a-c5e4-4a99-9a9b-671f5e5c0284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:41.103019 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692155ec-459c-4f48-85bc-cb70c031a5ae None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:41.103899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3457a-c5e4-4a99-9a9b-671f5e5c0284 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:41.104239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3457a-c5e4-4a99-9a9b-671f5e5c0284 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:41.104584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3457a-c5e4-4a99-9a9b-671f5e5c0284 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:41.105325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3457a-c5e4-4a99-9a9b-671f5e5c0284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:41.106789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3457a-c5e4-4a99-9a9b-671f5e5c0284 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:41.115168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 469/937] 10.222.0.64 () {56 vars in 1087 bytes} [Fri May 13 17:08:40 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:08:41.128188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3457a-c5e4-4a99-9a9b-671f5e5c0284 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:41.243172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692155ec-459c-4f48-85bc-cb70c031a5ae None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:41.247117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3457a-c5e4-4a99-9a9b-671f5e5c0284 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:41.279094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ce406-1ee9-4645-920a-916ef6c75748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:41.279935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce406-1ee9-4645-920a-916ef6c75748 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:41.280238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce406-1ee9-4645-920a-916ef6c75748 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:41.280520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce406-1ee9-4645-920a-916ef6c75748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:41.286103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad410a0-bff7-4619-b52d-98ffeba621cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:41.287297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad410a0-bff7-4619-b52d-98ffeba621cc None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:41.287800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad410a0-bff7-4619-b52d-98ffeba621cc None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:41.288296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad410a0-bff7-4619-b52d-98ffeba621cc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:41.288898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ce406-1ee9-4645-920a-916ef6c75748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:41.289374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad410a0-bff7-4619-b52d-98ffeba621cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:41.290412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ce406-1ee9-4645-920a-916ef6c75748 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:41.291254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad410a0-bff7-4619-b52d-98ffeba621cc None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-cad410a0-bff7-4619-b52d-98ffeba621cc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:41.305186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:41.306190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 17:08:41.307028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-282ce406-1ee9-4645-920a-916ef6c75748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:41.307863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:41.308638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:41.309524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:41.309524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:41.309524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:41.309524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:41.309524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:41.309524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:41.309524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:41.309524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:41.311712 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 470/939] 10.222.0.64 () {56 vars in 1132 bytes} [Fri May 13 17:08:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:41.315200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 469/939] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:41.317434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad410a0-bff7-4619-b52d-98ffeba621cc None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:41.318426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ce406-1ee9-4645-920a-916ef6c75748 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:41.442873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad410a0-bff7-4619-b52d-98ffeba621cc None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:41.444913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ce406-1ee9-4645-920a-916ef6c75748 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:41.484576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a35757-0c70-4cdc-974f-6e0a1210ba8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:41.485108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909beca-eea3-49e6-ae5f-585a44ff92a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:41.486045 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35757-0c70-4cdc-974f-6e0a1210ba8f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:41.486332 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909beca-eea3-49e6-ae5f-585a44ff92a8 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:41.486455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35757-0c70-4cdc-974f-6e0a1210ba8f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:41.486615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909beca-eea3-49e6-ae5f-585a44ff92a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:41.486842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35757-0c70-4cdc-974f-6e0a1210ba8f None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:41.486948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909beca-eea3-49e6-ae5f-585a44ff92a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:41.487692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a35757-0c70-4cdc-974f-6e0a1210ba8f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:41.487806 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909beca-eea3-49e6-ae5f-585a44ff92a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:41.488004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909beca-eea3-49e6-ae5f-585a44ff92a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:41.488162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a35757-0c70-4cdc-974f-6e0a1210ba8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:41.489446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909beca-eea3-49e6-ae5f-585a44ff92a8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:41.489640 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a35757-0c70-4cdc-974f-6e0a1210ba8f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:41.495068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 471/940] 10.222.0.64 () {56 vars in 1126 bytes} [Fri May 13 17:08:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:41.500137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a35757-0c70-4cdc-974f-6e0a1210ba8f None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:41.502544 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 470/941] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:41.514645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909beca-eea3-49e6-ae5f-585a44ff92a8 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:41.623168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a35757-0c70-4cdc-974f-6e0a1210ba8f None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:41.635171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909beca-eea3-49e6-ae5f-585a44ff92a8 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:41.666032 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a69afb-1ad7-44a2-af94-7295d7f34f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:41.667248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69afb-1ad7-44a2-af94-7295d7f34f65 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:41.668101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69afb-1ad7-44a2-af94-7295d7f34f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:41.669039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69afb-1ad7-44a2-af94-7295d7f34f65 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:41.669907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a69afb-1ad7-44a2-af94-7295d7f34f65 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:41.670844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a69afb-1ad7-44a2-af94-7295d7f34f65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:41.672887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a69afb-1ad7-44a2-af94-7295d7f34f65 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:41.674765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df35d6f-3307-4039-b2ad-6e20da01ecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:41.676262 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35d6f-3307-4039-b2ad-6e20da01ecf3 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:41.676705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35d6f-3307-4039-b2ad-6e20da01ecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:41.677077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35d6f-3307-4039-b2ad-6e20da01ecf3 None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/762c7aace59a4d02bf76f1e59bb21f0e/roles/b1d2c3a8bfec44aeacafbdc51013fad7` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:41.678825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 472/942] 10.222.0.64 () {56 vars in 1126 bytes} [Fri May 13 17:08:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:41.683211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df35d6f-3307-4039-b2ad-6e20da01ecf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=762c7aace59a4d02bf76f1e59bb21f0e, role_id=b1d2c3a8bfec44aeacafbdc51013fad7)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:41.683211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df35d6f-3307-4039-b2ad-6e20da01ecf3 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:41.684352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a69afb-1ad7-44a2-af94-7295d7f34f65 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:41.756187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 471/943] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:08:41 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/762c7aace59a4d02bf76f1e59bb21f0e/roles/b1d2c3a8bfec44aeacafbdc51013fad7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:08:41.792596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a69afb-1ad7-44a2-af94-7295d7f34f65 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:41.831180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638c5b3-1872-4f26-b8c9-ee53eab2bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:41.832108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c5b3-1872-4f26-b8c9-ee53eab2bc1e None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:41.832537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c5b3-1872-4f26-b8c9-ee53eab2bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:41.832957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c5b3-1872-4f26-b8c9-ee53eab2bc1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:41.833882 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638c5b3-1872-4f26-b8c9-ee53eab2bc1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:41.835534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638c5b3-1872-4f26-b8c9-ee53eab2bc1e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:41.950971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 473/944] 10.222.0.64 () {60 vars in 1144 bytes} [Fri May 13 17:08:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:42.454971 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01700b-3c48-4479-ab79-75336cda99c2 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:42.455485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01700b-3c48-4479-ab79-75336cda99c2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:42.455772 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01700b-3c48-4479-ab79-75336cda99c2 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:42.457413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 472/945] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:42.462855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754b8b8-9734-4b9d-97a2-2bb43de594d8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:42.463329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754b8b8-9734-4b9d-97a2-2bb43de594d8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:42.463508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754b8b8-9734-4b9d-97a2-2bb43de594d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:42.480219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2754b8b8-9734-4b9d-97a2-2bb43de594d8 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:42.481401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2754b8b8-9734-4b9d-97a2-2bb43de594d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:42.559236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 474/946] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:42.577374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01700b-3c48-4479-ab79-75336cda99c2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:42.678819 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01700b-3c48-4479-ab79-75336cda99c2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:42.713951 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9e436-2ff2-4d21-b57c-7fb8bc02672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:42.714541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9e436-2ff2-4d21-b57c-7fb8bc02672f None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:42.714824 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9e436-2ff2-4d21-b57c-7fb8bc02672f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:42.715166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9e436-2ff2-4d21-b57c-7fb8bc02672f None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:42.715896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9e436-2ff2-4d21-b57c-7fb8bc02672f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:42.717380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9e436-2ff2-4d21-b57c-7fb8bc02672f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:42.718819 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: WARNING keystone.server.flask.common [None req-90c9e436-2ff2-4d21-b57c-7fb8bc02672f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 13 17:08:42.771479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.sql.core [None req-90c9e436-2ff2-4d21-b57c-7fb8bc02672f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 17:08:42.771479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 13 17:08:42.771479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [parameters: {'id': 'd98ebe22871c49ecb8b13c1c534416e1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 13 17:08:42.771479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80073) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-90c9e436-2ff2-4d21-b57c-7fb8bc02672f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d98ebe22871c49ecb8b13c1c534416e1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d98ebe22871c49ecb8b13c1c534416e1. May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application result = self._query(query) May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application conn.query(q) May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 17:08:42.789113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application result.read() May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 13 17:08:42.789977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return project_ref.to_dict() May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application next(self.gen) May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application yield resource May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application next(self.gen) May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self.session.rollback() May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self.force_reraise() May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise self.value May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application session.commit() May 13 17:08:42.790967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._prepare_impl() May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self.session.flush() May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._flush(objects) May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application compat.raise_( May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application flush_context.execute() May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 17:08:42.791947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rec.execute(self) May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application c = connection._execute_20( May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 17:08:42.792887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application result = self._query(query) May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application conn.query(q) May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application result.read() May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 17:08:42.793691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [parameters: {'id': 'd98ebe22871c49ecb8b13c1c534416e1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:42.794580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:42.796878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:42.799656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:42.799656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 13 17:08:42.799656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 13 17:08:42.799656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:42.799656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:42.799656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 13 17:08:42.799656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.Conflict( May 13 17:08:42.799656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d98ebe22871c49ecb8b13c1c534416e1. May 13 17:08:42.799656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:42.799656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 473/947] 10.222.0.64 () {60 vars in 1140 bytes} [Fri May 13 17:08:42 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:42.800986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754b8b8-9734-4b9d-97a2-2bb43de594d8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:42.898647 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754b8b8-9734-4b9d-97a2-2bb43de594d8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:42.934572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575503a-5129-4fe2-a060-bc5e54ec43f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:42.935756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575503a-5129-4fe2-a060-bc5e54ec43f0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:42.936269 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575503a-5129-4fe2-a060-bc5e54ec43f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:42.936746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575503a-5129-4fe2-a060-bc5e54ec43f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:42.944418 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575503a-5129-4fe2-a060-bc5e54ec43f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:42.946162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575503a-5129-4fe2-a060-bc5e54ec43f0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-e575503a-5129-4fe2-a060-bc5e54ec43f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:42.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:42.961994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:42.962897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:42.962897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:42.962897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:42.962897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:42.962897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:42.962897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:42.962897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:42.962897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:42.965564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 475/948] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:42.972101 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9e436-2ff2-4d21-b57c-7fb8bc02672f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:43.078800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9e436-2ff2-4d21-b57c-7fb8bc02672f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:43.113712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7d188-e713-4db3-b720-6ba9076c6dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:43.114387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d188-e713-4db3-b720-6ba9076c6dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:43.114669 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d188-e713-4db3-b720-6ba9076c6dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:43.114942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d188-e713-4db3-b720-6ba9076c6dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:43.115730 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7d188-e713-4db3-b720-6ba9076c6dd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:43.116037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7d188-e713-4db3-b720-6ba9076c6dd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:43.117689 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7d188-e713-4db3-b720-6ba9076c6dd9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:43.142494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 474/949] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:43.400894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa880e0e-4e9b-42a6-b9c8-537f4eb86d3d None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:43.401266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa880e0e-4e9b-42a6-b9c8-537f4eb86d3d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:43.401470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa880e0e-4e9b-42a6-b9c8-537f4eb86d3d None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:43.403012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 476/950] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:43.409285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc099e-d4d6-4991-b896-a5c4c6b34326 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:43.409578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc099e-d4d6-4991-b896-a5c4c6b34326 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:43.409858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc099e-d4d6-4991-b896-a5c4c6b34326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:43.428738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-82dc099e-d4d6-4991-b896-a5c4c6b34326 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:43.431057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-82dc099e-d4d6-4991-b896-a5c4c6b34326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:43.511231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 475/951] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:43.528222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa880e0e-4e9b-42a6-b9c8-537f4eb86d3d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:43.631392 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa880e0e-4e9b-42a6-b9c8-537f4eb86d3d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:43.669417 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea850816-2833-4d1c-b4a0-da9bed8f3cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:43.670146 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea850816-2833-4d1c-b4a0-da9bed8f3cff None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:43.670420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea850816-2833-4d1c-b4a0-da9bed8f3cff None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:43.670686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea850816-2833-4d1c-b4a0-da9bed8f3cff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:43.671353 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea850816-2833-4d1c-b4a0-da9bed8f3cff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:43.673286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea850816-2833-4d1c-b4a0-da9bed8f3cff None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-ea850816-2833-4d1c-b4a0-da9bed8f3cff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:43.685436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:43.686439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:43.687479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 477/952] 10.222.0.64 () {56 vars in 1126 bytes} [Fri May 13 17:08:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:43.695077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc099e-d4d6-4991-b896-a5c4c6b34326 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:43.800233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc099e-d4d6-4991-b896-a5c4c6b34326 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:43.835507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11f7f-fcf6-4e95-a1e5-9a07e7a5e32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:43.836558 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11f7f-fcf6-4e95-a1e5-9a07e7a5e32c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:43.837046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11f7f-fcf6-4e95-a1e5-9a07e7a5e32c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:43.837523 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11f7f-fcf6-4e95-a1e5-9a07e7a5e32c None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:43.838448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11f7f-fcf6-4e95-a1e5-9a07e7a5e32c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:43.838955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11f7f-fcf6-4e95-a1e5-9a07e7a5e32c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:43.840542 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11f7f-fcf6-4e95-a1e5-9a07e7a5e32c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:43.851157 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 476/953] 10.222.0.64 () {56 vars in 1122 bytes} [Fri May 13 17:08:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:43.852799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea850816-2833-4d1c-b4a0-da9bed8f3cff None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:43.956677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea850816-2833-4d1c-b4a0-da9bed8f3cff None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:43.995167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aca50c-3602-4507-b0d7-5b70e7b4133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:43.999149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca50c-3602-4507-b0d7-5b70e7b4133b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:43.999149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca50c-3602-4507-b0d7-5b70e7b4133b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:43.999149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca50c-3602-4507-b0d7-5b70e7b4133b None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:43.999149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aca50c-3602-4507-b0d7-5b70e7b4133b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:43.999149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aca50c-3602-4507-b0d7-5b70e7b4133b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:43.999149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aca50c-3602-4507-b0d7-5b70e7b4133b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:44.009699 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 478/954] 10.222.0.64 () {56 vars in 1122 bytes} [Fri May 13 17:08:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:44.011059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11f7f-fcf6-4e95-a1e5-9a07e7a5e32c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:44.113360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11f7f-fcf6-4e95-a1e5-9a07e7a5e32c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:44.150444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68b5f2-d802-4799-a2ee-b16d3aa619f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:44.151103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b5f2-d802-4799-a2ee-b16d3aa619f9 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:44.151406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b5f2-d802-4799-a2ee-b16d3aa619f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:44.151680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68b5f2-d802-4799-a2ee-b16d3aa619f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:44.152468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68b5f2-d802-4799-a2ee-b16d3aa619f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:44.153918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68b5f2-d802-4799-a2ee-b16d3aa619f9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:44.167110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f350a-8651-4f50-9f86-c93a59f83de5 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:44.167425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f350a-8651-4f50-9f86-c93a59f83de5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:44.167754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f350a-8651-4f50-9f86-c93a59f83de5 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:44.169329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 479/955] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:44.174744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b525a9-cb7b-4508-8077-e69cf7419b85 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:44.174996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b525a9-cb7b-4508-8077-e69cf7419b85 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:44.175304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b525a9-cb7b-4508-8077-e69cf7419b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:44.191639 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d7b525a9-cb7b-4508-8077-e69cf7419b85 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:44.192847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d7b525a9-cb7b-4508-8077-e69cf7419b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:44.232397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 477/956] 10.222.0.64 () {60 vars in 1144 bytes} [Fri May 13 17:08:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:44.288108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 480/957] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:44.299591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6fad2-36b0-4e08-a438-d82dd93553ec None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:44.299953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6fad2-36b0-4e08-a438-d82dd93553ec None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:44.300202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6fad2-36b0-4e08-a438-d82dd93553ec None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:44.302085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 478/958] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:44.309530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6fad2-36b0-4e08-a438-d82dd93553ec None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:44.310598 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ff0ed-5af7-4fff-b576-cd97ba43dd3b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:44.311098 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ff0ed-5af7-4fff-b576-cd97ba43dd3b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:44.311649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ff0ed-5af7-4fff-b576-cd97ba43dd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:44.332226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-162ff0ed-5af7-4fff-b576-cd97ba43dd3b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:44.334091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-162ff0ed-5af7-4fff-b576-cd97ba43dd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:44.422771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 481/959] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:44.436551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6fad2-36b0-4e08-a438-d82dd93553ec None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:44.445017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ff0ed-5af7-4fff-b576-cd97ba43dd3b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:44.481488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd1463-a53c-4a55-92d9-48e5fbd7eb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:44.482299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd1463-a53c-4a55-92d9-48e5fbd7eb77 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:44.482632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd1463-a53c-4a55-92d9-48e5fbd7eb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:44.482847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd1463-a53c-4a55-92d9-48e5fbd7eb77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:44.493860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd1463-a53c-4a55-92d9-48e5fbd7eb77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-a0dd1463-a53c-4a55-92d9-48e5fbd7eb77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:44.502172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:44.503107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:44.504036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 479/960] 10.222.0.64 () {56 vars in 1120 bytes} [Fri May 13 17:08:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:44.509339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd1463-a53c-4a55-92d9-48e5fbd7eb77 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:44.555869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ff0ed-5af7-4fff-b576-cd97ba43dd3b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:44.590147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411109b3-be29-488d-ae0d-9050d6fd4c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:44.590938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411109b3-be29-488d-ae0d-9050d6fd4c72 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:44.591243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411109b3-be29-488d-ae0d-9050d6fd4c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:44.591511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411109b3-be29-488d-ae0d-9050d6fd4c72 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:44.592153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411109b3-be29-488d-ae0d-9050d6fd4c72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:44.593535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411109b3-be29-488d-ae0d-9050d6fd4c72 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-411109b3-be29-488d-ae0d-9050d6fd4c72 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:44.605772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:44.606793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:44.607661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 482/961] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:44.612920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411109b3-be29-488d-ae0d-9050d6fd4c72 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:44.619789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd1463-a53c-4a55-92d9-48e5fbd7eb77 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:44.653433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d8b99-4b96-4f76-b441-3dbe4cba97ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:44.654091 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8b99-4b96-4f76-b441-3dbe4cba97ad None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:44.654373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8b99-4b96-4f76-b441-3dbe4cba97ad None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:44.654647 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8b99-4b96-4f76-b441-3dbe4cba97ad None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:44.655486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d8b99-4b96-4f76-b441-3dbe4cba97ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:44.655792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d8b99-4b96-4f76-b441-3dbe4cba97ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:44.657771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d8b99-4b96-4f76-b441-3dbe4cba97ad None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:44.670523 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 480/962] 10.222.0.64 () {56 vars in 1115 bytes} [Fri May 13 17:08:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:44.671854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d8b99-4b96-4f76-b441-3dbe4cba97ad None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:44.710491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411109b3-be29-488d-ae0d-9050d6fd4c72 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:44.745458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caab460-f9d9-44c1-8fdf-e10f61d93ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:44.746442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caab460-f9d9-44c1-8fdf-e10f61d93ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:44.746442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caab460-f9d9-44c1-8fdf-e10f61d93ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:44.746617 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caab460-f9d9-44c1-8fdf-e10f61d93ae2 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:44.747355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caab460-f9d9-44c1-8fdf-e10f61d93ae2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:44.747660 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caab460-f9d9-44c1-8fdf-e10f61d93ae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:44.749041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caab460-f9d9-44c1-8fdf-e10f61d93ae2 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:44.758407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 483/963] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:44.759249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caab460-f9d9-44c1-8fdf-e10f61d93ae2 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:44.783049 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d8b99-4b96-4f76-b441-3dbe4cba97ad None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:44.817250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a043b-50bb-4ca6-a1ba-dc87610a43e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:44.818447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a043b-50bb-4ca6-a1ba-dc87610a43e4 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:44.818940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a043b-50bb-4ca6-a1ba-dc87610a43e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:44.819453 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a043b-50bb-4ca6-a1ba-dc87610a43e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:44.831406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a043b-50bb-4ca6-a1ba-dc87610a43e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:44.833192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a043b-50bb-4ca6-a1ba-dc87610a43e4 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-567a043b-50bb-4ca6-a1ba-dc87610a43e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:44.851092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:44.852025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:44.852918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:44.852918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:44.852918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:44.852918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:44.855189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 481/964] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:44.861056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a043b-50bb-4ca6-a1ba-dc87610a43e4 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:44.863745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caab460-f9d9-44c1-8fdf-e10f61d93ae2 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:44.898681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57baf9-222e-4a86-8286-6ffd26a0131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:44.899559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57baf9-222e-4a86-8286-6ffd26a0131b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:44.899850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57baf9-222e-4a86-8286-6ffd26a0131b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:44.900125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57baf9-222e-4a86-8286-6ffd26a0131b None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:44.900902 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57baf9-222e-4a86-8286-6ffd26a0131b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:44.901209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57baf9-222e-4a86-8286-6ffd26a0131b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:44.902604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57baf9-222e-4a86-8286-6ffd26a0131b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:44.908292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 484/965] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:44.977992 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a043b-50bb-4ca6-a1ba-dc87610a43e4 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:45.023869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e861-6301-4ea6-8815-e026a4b1ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:45.024913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e861-6301-4ea6-8815-e026a4b1ae6e None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:45.025401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e861-6301-4ea6-8815-e026a4b1ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:45.025915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e861-6301-4ea6-8815-e026a4b1ae6e None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:45.026862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99e861-6301-4ea6-8815-e026a4b1ae6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:45.027462 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99e861-6301-4ea6-8815-e026a4b1ae6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:45.029099 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99e861-6301-4ea6-8815-e026a4b1ae6e None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:45.043710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 482/966] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:45.050718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57baf9-222e-4a86-8286-6ffd26a0131b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:45.152513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57baf9-222e-4a86-8286-6ffd26a0131b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:45.186601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525f3a-9d03-4c4a-a1f2-6d5bec69954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:45.187852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525f3a-9d03-4c4a-a1f2-6d5bec69954d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:45.188374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525f3a-9d03-4c4a-a1f2-6d5bec69954d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:45.188866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525f3a-9d03-4c4a-a1f2-6d5bec69954d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:45.196892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73525f3a-9d03-4c4a-a1f2-6d5bec69954d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:45.198636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73525f3a-9d03-4c4a-a1f2-6d5bec69954d None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-73525f3a-9d03-4c4a-a1f2-6d5bec69954d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:45.213806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:45.214783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:45.215771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:45.215771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:45.215771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:45.215771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:45.215771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:45.215771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:45.215771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:45.215771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:45.215771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 17:08:45.215771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:45.223224 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 485/967] 10.222.0.64 () {56 vars in 1117 bytes} [Fri May 13 17:08:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:45.224798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e861-6301-4ea6-8815-e026a4b1ae6e None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:45.332933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e861-6301-4ea6-8815-e026a4b1ae6e None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:45.367999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71169a-f06a-46ce-9034-d9402ed00b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:45.368664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71169a-f06a-46ce-9034-d9402ed00b9a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:45.368948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71169a-f06a-46ce-9034-d9402ed00b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:45.369222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71169a-f06a-46ce-9034-d9402ed00b9a None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:45.370059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71169a-f06a-46ce-9034-d9402ed00b9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:45.370365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71169a-f06a-46ce-9034-d9402ed00b9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:45.371840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71169a-f06a-46ce-9034-d9402ed00b9a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:45.389973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 483/968] 10.222.0.64 () {56 vars in 1149 bytes} [Fri May 13 17:08:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:45.395688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525f3a-9d03-4c4a-a1f2-6d5bec69954d None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:45.488989 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f563265-e62a-4212-a18b-fb8dfb695332 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:45.489312 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f563265-e62a-4212-a18b-fb8dfb695332 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:45.489551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f563265-e62a-4212-a18b-fb8dfb695332 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:45.491046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 484/969] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:45.496179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fddf1-5e96-40ea-b145-a9b0709e056e None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:45.496694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fddf1-5e96-40ea-b145-a9b0709e056e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:45.497171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fddf1-5e96-40ea-b145-a9b0709e056e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:45.504601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525f3a-9d03-4c4a-a1f2-6d5bec69954d None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:45.515727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-df0fddf1-5e96-40ea-b145-a9b0709e056e None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:45.517417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-df0fddf1-5e96-40ea-b145-a9b0709e056e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:45.538831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142d27-81f0-44d1-9df0-8b8f720a4a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:45.539504 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142d27-81f0-44d1-9df0-8b8f720a4a11 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:45.539782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142d27-81f0-44d1-9df0-8b8f720a4a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:45.540052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142d27-81f0-44d1-9df0-8b8f720a4a11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:45.599429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 485/970] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:45.607593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c142d27-81f0-44d1-9df0-8b8f720a4a11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:45.609093 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c142d27-81f0-44d1-9df0-8b8f720a4a11 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:45.620754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fddf1-5e96-40ea-b145-a9b0709e056e None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:45.713687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 486/971] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:45 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:08:45.718689 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142d27-81f0-44d1-9df0-8b8f720a4a11 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:45.745531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fddf1-5e96-40ea-b145-a9b0709e056e None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:45.779440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c95b9-3e77-452c-833a-6fc996971d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:45.780448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c95b9-3e77-452c-833a-6fc996971d4d None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:45.781085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c95b9-3e77-452c-833a-6fc996971d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:45.781583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c95b9-3e77-452c-833a-6fc996971d4d None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:45.783048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c95b9-3e77-452c-833a-6fc996971d4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:45.784740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c95b9-3e77-452c-833a-6fc996971d4d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:45.816479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142d27-81f0-44d1-9df0-8b8f720a4a11 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:45.843391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.sql.core [None req-004c95b9-3e77-452c-833a-6fc996971d4d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 17:08:45.843391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 13 17:08:45.843391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [parameters: {'user_id': '7dcc8bd22d984647ae019af56d455247', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 13 17:08:45.843391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80073) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 17:08:45.850878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfdd23-0a92-41d1-9de5-665b18ef49d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-004c95b9-3e77-452c-833a-6fc996971d4d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application result = self._query(query) May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application conn.query(q) May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application result.read() May 13 17:08:45.851790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 17:08:45.852672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application next(self.gen) May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application yield resource May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application next(self.gen) May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self.session.rollback() May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self.force_reraise() May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise self.value May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application session.commit() May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 17:08:45.853667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._prepare_impl() May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self.session.flush() May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._flush(objects) May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application compat.raise_( May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application flush_context.execute() May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rec.execute(self) May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 17:08:45.854654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application result = connection._execute_20( May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 17:08:45.855637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application result = self._query(query) May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application conn.query(q) May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application result.read() May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 17:08:45.856488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [parameters: {'user_id': '7dcc8bd22d984647ae019af56d455247', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:45.857329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 13 17:08:45.858168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 13 17:08:45.859102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 13 17:08:45.859102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 13 17:08:45.859102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 17:08:45.859102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 17:08:45.859102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 13 17:08:45.859102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:45.859102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 486/972] 10.222.0.64 () {60 vars in 1131 bytes} [Fri May 13 17:08:45 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:45.862039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c95b9-3e77-452c-833a-6fc996971d4d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:45.863022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfdd23-0a92-41d1-9de5-665b18ef49d6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:45.863022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfdd23-0a92-41d1-9de5-665b18ef49d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:45.864061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfdd23-0a92-41d1-9de5-665b18ef49d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:45.874441 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfdd23-0a92-41d1-9de5-665b18ef49d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:45.876344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfdd23-0a92-41d1-9de5-665b18ef49d6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-a2bfdd23-0a92-41d1-9de5-665b18ef49d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:45.894679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:45.895610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:45.896541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:45.896541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:45.896541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:45.896541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:45.898740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 487/973] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:45.908727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfdd23-0a92-41d1-9de5-665b18ef49d6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:45.968525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c95b9-3e77-452c-833a-6fc996971d4d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:46.002986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85ba3-cf6f-4acb-b4f7-e679aa62e711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:46.003906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85ba3-cf6f-4acb-b4f7-e679aa62e711 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:46.004124 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85ba3-cf6f-4acb-b4f7-e679aa62e711 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:46.004415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85ba3-cf6f-4acb-b4f7-e679aa62e711 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:46.012576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85ba3-cf6f-4acb-b4f7-e679aa62e711 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:46.013489 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfdd23-0a92-41d1-9de5-665b18ef49d6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:46.014233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85ba3-cf6f-4acb-b4f7-e679aa62e711 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-d9c85ba3-cf6f-4acb-b4f7-e679aa62e711 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:46.028667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:46.029642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:46.030767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:46.030767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:46.030767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:46.030767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:46.030767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:46.030767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:46.030767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:46.030767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:46.030767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 17:08:46.030767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:46.034662 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 487/974] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:46.035944 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85ba3-cf6f-4acb-b4f7-e679aa62e711 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:46.054677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d9fe-ddb3-473a-889a-ac858cf7d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:46.055816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d9fe-ddb3-473a-889a-ac858cf7d824 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:46.056321 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d9fe-ddb3-473a-889a-ac858cf7d824 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:46.056798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d9fe-ddb3-473a-889a-ac858cf7d824 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:46.057930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7d9fe-ddb3-473a-889a-ac858cf7d824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:46.058429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7d9fe-ddb3-473a-889a-ac858cf7d824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:46.060074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7d9fe-ddb3-473a-889a-ac858cf7d824 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:46.077724 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 488/975] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:46.078872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d9fe-ddb3-473a-889a-ac858cf7d824 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:46.140355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85ba3-cf6f-4acb-b4f7-e679aa62e711 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:46.174257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752593c-d4a9-40d4-901b-48b319d0e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:46.174936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752593c-d4a9-40d4-901b-48b319d0e7ac None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:46.175276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752593c-d4a9-40d4-901b-48b319d0e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:46.175543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752593c-d4a9-40d4-901b-48b319d0e7ac None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:46.176340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752593c-d4a9-40d4-901b-48b319d0e7ac None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:46.176647 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752593c-d4a9-40d4-901b-48b319d0e7ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:46.178228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752593c-d4a9-40d4-901b-48b319d0e7ac None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:46.184007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d9fe-ddb3-473a-889a-ac858cf7d824 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:46.219744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44272852-52fe-46c0-9e57-e6a19b27bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:46.220927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44272852-52fe-46c0-9e57-e6a19b27bc61 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:46.221389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44272852-52fe-46c0-9e57-e6a19b27bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:46.221842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44272852-52fe-46c0-9e57-e6a19b27bc61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:46.223254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 488/976] 10.222.0.64 () {56 vars in 1101 bytes} [Fri May 13 17:08:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:46.230781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44272852-52fe-46c0-9e57-e6a19b27bc61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:46.232784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44272852-52fe-46c0-9e57-e6a19b27bc61 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-44272852-52fe-46c0-9e57-e6a19b27bc61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:46.250350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:46.252065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:46.252951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:46.252951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:46.252951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:46.252951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:46.252951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:46.252951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:46.252951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:46.252951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:46.255512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 489/977] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:46.261598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752593c-d4a9-40d4-901b-48b319d0e7ac None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:46.371067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752593c-d4a9-40d4-901b-48b319d0e7ac None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:46.409096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f716f-9ae8-4702-989b-f2deb62f8d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:46.409291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f716f-9ae8-4702-989b-f2deb62f8d55 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:46.409471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f716f-9ae8-4702-989b-f2deb62f8d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:46.409749 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f716f-9ae8-4702-989b-f2deb62f8d55 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:46.410547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f716f-9ae8-4702-989b-f2deb62f8d55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:46.410856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f716f-9ae8-4702-989b-f2deb62f8d55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:46.412350 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f716f-9ae8-4702-989b-f2deb62f8d55 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:46.425549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 489/978] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:46.431612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44272852-52fe-46c0-9e57-e6a19b27bc61 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:46.536385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44272852-52fe-46c0-9e57-e6a19b27bc61 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:46.569822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61850d69-ed8a-4460-9399-355937c98182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:46.570571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61850d69-ed8a-4460-9399-355937c98182 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:46.570925 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61850d69-ed8a-4460-9399-355937c98182 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:46.571297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61850d69-ed8a-4460-9399-355937c98182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:46.572218 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61850d69-ed8a-4460-9399-355937c98182 None admin] RBAC: Adding query filter params (role.id=b1d2c3a8bfec44aeacafbdc51013fad7, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=762c7aace59a4d02bf76f1e59bb21f0e) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:46.572602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61850d69-ed8a-4460-9399-355937c98182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:46.574119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61850d69-ed8a-4460-9399-355937c98182 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:46.580834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 490/979] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:46 2022] GET /identity/v3/role_assignments?user.id=762c7aace59a4d02bf76f1e59bb21f0e&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=b1d2c3a8bfec44aeacafbdc51013fad7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:46.662894 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabd28f-5521-4b95-8fbc-7a12d9ec01da None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:46.663202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabd28f-5521-4b95-8fbc-7a12d9ec01da None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:46.663526 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabd28f-5521-4b95-8fbc-7a12d9ec01da None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:46.665234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 490/980] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:46.670734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16973ce-d1c5-4ad7-887a-7526f30899a9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:46.671293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16973ce-d1c5-4ad7-887a-7526f30899a9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:46.671384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16973ce-d1c5-4ad7-887a-7526f30899a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:46.689101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e16973ce-d1c5-4ad7-887a-7526f30899a9 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:46.690310 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e16973ce-d1c5-4ad7-887a-7526f30899a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:46.759969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 491/981] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:46.782050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabd28f-5521-4b95-8fbc-7a12d9ec01da None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:46.882707 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabd28f-5521-4b95-8fbc-7a12d9ec01da None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:46.914403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae9469-77d1-44cf-b9a3-9551f7732ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:46.915149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae9469-77d1-44cf-b9a3-9551f7732ebc None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:46.915435 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae9469-77d1-44cf-b9a3-9551f7732ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:46.915710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae9469-77d1-44cf-b9a3-9551f7732ebc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:46.916362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae9469-77d1-44cf-b9a3-9551f7732ebc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:46.917767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae9469-77d1-44cf-b9a3-9551f7732ebc None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-26ae9469-77d1-44cf-b9a3-9551f7732ebc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:46.930356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:46.931702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:46.932559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 491/982] 10.222.0.64 () {56 vars in 1126 bytes} [Fri May 13 17:08:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:46.939974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16973ce-d1c5-4ad7-887a-7526f30899a9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:47.046626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16973ce-d1c5-4ad7-887a-7526f30899a9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:47.080617 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f64883-3d99-4f78-bd00-1ce64b5821ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:47.081284 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64883-3d99-4f78-bd00-1ce64b5821ea None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:47.081692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64883-3d99-4f78-bd00-1ce64b5821ea None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:47.081974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64883-3d99-4f78-bd00-1ce64b5821ea None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:47.082677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f64883-3d99-4f78-bd00-1ce64b5821ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:47.082982 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f64883-3d99-4f78-bd00-1ce64b5821ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:47.084399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f64883-3d99-4f78-bd00-1ce64b5821ea None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:47.093627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 492/983] 10.222.0.64 () {56 vars in 1122 bytes} [Fri May 13 17:08:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:47.094760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae9469-77d1-44cf-b9a3-9551f7732ebc None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:47.192462 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae9469-77d1-44cf-b9a3-9551f7732ebc None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:47.203770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f4865-3d15-4b4c-8d97-45fca7650513 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:47.204606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f4865-3d15-4b4c-8d97-45fca7650513 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:47.204896 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f4865-3d15-4b4c-8d97-45fca7650513 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:47.206411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 493/984] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:47.211012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145136-38d9-492a-a481-0f8565ab4a56 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:47.211329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145136-38d9-492a-a481-0f8565ab4a56 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:47.211605 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145136-38d9-492a-a481-0f8565ab4a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:47.227004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5dcb3-f275-4679-86a9-62bfba4bc8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:47.227836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5dcb3-f275-4679-86a9-62bfba4bc8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:47.228219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5dcb3-f275-4679-86a9-62bfba4bc8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:47.228377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5c145136-38d9-492a-a481-0f8565ab4a56 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:47.228684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5dcb3-f275-4679-86a9-62bfba4bc8e9 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:47.229495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5dcb3-f275-4679-86a9-62bfba4bc8e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:47.229601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5c145136-38d9-492a-a481-0f8565ab4a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:47.229977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5dcb3-f275-4679-86a9-62bfba4bc8e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:47.231483 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5dcb3-f275-4679-86a9-62bfba4bc8e9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:47.236597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 492/985] 10.222.0.64 () {56 vars in 1122 bytes} [Fri May 13 17:08:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:47.241992 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5dcb3-f275-4679-86a9-62bfba4bc8e9 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:47.296086 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 494/986] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:47.318578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c145136-38d9-492a-a481-0f8565ab4a56 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:47.344202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5dcb3-f275-4679-86a9-62bfba4bc8e9 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:47.387113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bcc3d-29ab-4a2d-9564-564417904fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:47.387940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bcc3d-29ab-4a2d-9564-564417904fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:47.388224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bcc3d-29ab-4a2d-9564-564417904fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:47.392717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bcc3d-29ab-4a2d-9564-564417904fe1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:47.392717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bcc3d-29ab-4a2d-9564-564417904fe1 None admin] RBAC: Adding query filter params (interface=admin, service_id=bcd30e98cfb94b2e9f8c7aaaf1447bde, region_id=RegionOne) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:47.392717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bcc3d-29ab-4a2d-9564-564417904fe1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:47.392717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bcc3d-29ab-4a2d-9564-564417904fe1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:47.396667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 493/987] 10.222.0.64 () {56 vars in 1249 bytes} [Fri May 13 17:08:47 2022] GET /identity/v3/endpoints?service_id=bcd30e98cfb94b2e9f8c7aaaf1447bde&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:47.402139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bcc3d-29ab-4a2d-9564-564417904fe1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:47.420081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c145136-38d9-492a-a481-0f8565ab4a56 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:47.455762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9876c-577f-4546-98ff-b0ca4ec7e7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:47.456359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9876c-577f-4546-98ff-b0ca4ec7e7e6 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:47.456646 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9876c-577f-4546-98ff-b0ca4ec7e7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:47.456919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9876c-577f-4546-98ff-b0ca4ec7e7e6 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:47.457636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9876c-577f-4546-98ff-b0ca4ec7e7e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:47.459027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9876c-577f-4546-98ff-b0ca4ec7e7e6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:47.510904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bcc3d-29ab-4a2d-9564-564417904fe1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:47.543614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d353029-e905-4c22-8218-481f75828670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:47.544274 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353029-e905-4c22-8218-481f75828670 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:47.544559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353029-e905-4c22-8218-481f75828670 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:47.544837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353029-e905-4c22-8218-481f75828670 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:47.545521 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d353029-e905-4c22-8218-481f75828670 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:47.546983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 495/988] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:08:47 2022] POST /identity/v3/services => generated 242 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:08:47.547096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d353029-e905-4c22-8218-481f75828670 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:47.559506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 494/989] 10.222.0.64 () {56 vars in 1087 bytes} [Fri May 13 17:08:47 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:08:48.853301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0987b0-594f-4c39-8908-a6ffbb245f66 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:48.853852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0987b0-594f-4c39-8908-a6ffbb245f66 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:48.853852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0987b0-594f-4c39-8908-a6ffbb245f66 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:48.855490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 496/990] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:48.860714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4880b-5d56-4df4-bdcd-93ea2b61f840 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:48.861146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4880b-5d56-4df4-bdcd-93ea2b61f840 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:48.861392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4880b-5d56-4df4-bdcd-93ea2b61f840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:48.878362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-89f4880b-5d56-4df4-bdcd-93ea2b61f840 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:48.879906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-89f4880b-5d56-4df4-bdcd-93ea2b61f840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:48.948996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 495/991] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:48.971648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0987b0-594f-4c39-8908-a6ffbb245f66 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:49.072815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0987b0-594f-4c39-8908-a6ffbb245f66 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:49.105621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59d264-6a62-433f-ae5d-7dda91828d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:49.106334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59d264-6a62-433f-ae5d-7dda91828d50 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:49.106613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59d264-6a62-433f-ae5d-7dda91828d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:49.106883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59d264-6a62-433f-ae5d-7dda91828d50 None admin] PATH_INFO: `/v3/services/image` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:49.107576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59d264-6a62-433f-ae5d-7dda91828d50 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:49.108958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59d264-6a62-433f-ae5d-7dda91828d50 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-3f59d264-6a62-433f-ae5d-7dda91828d50 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:49.120866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:49.121890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:49.128091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 497/992] 10.222.0.64 () {56 vars in 1105 bytes} [Fri May 13 17:08:48 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:49.130959 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4880b-5d56-4df4-bdcd-93ea2b61f840 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:49.224326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4880b-5d56-4df4-bdcd-93ea2b61f840 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:49.257618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25af0f3-24bf-4bf2-9afe-27c7f68483a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:49.258284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25af0f3-24bf-4bf2-9afe-27c7f68483a4 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:49.258567 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25af0f3-24bf-4bf2-9afe-27c7f68483a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:49.258837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25af0f3-24bf-4bf2-9afe-27c7f68483a4 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:49.259565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25af0f3-24bf-4bf2-9afe-27c7f68483a4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:49.259870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25af0f3-24bf-4bf2-9afe-27c7f68483a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:49.261239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25af0f3-24bf-4bf2-9afe-27c7f68483a4 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:49.266034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 496/993] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:49.271634 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59d264-6a62-433f-ae5d-7dda91828d50 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:49.370128 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59d264-6a62-433f-ae5d-7dda91828d50 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:49.402908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605b449-d943-4e79-a925-936df170708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:49.403612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b449-d943-4e79-a925-936df170708f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:49.403892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b449-d943-4e79-a925-936df170708f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:49.404157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605b449-d943-4e79-a925-936df170708f None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:49.404982 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605b449-d943-4e79-a925-936df170708f None admin] RBAC: Adding query filter params (type=image) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:49.405294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605b449-d943-4e79-a925-936df170708f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:49.406686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605b449-d943-4e79-a925-936df170708f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:49.419453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 498/994] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:49.774409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce724c72-068c-469f-8d97-d584969c2b0f None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:49.774701 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce724c72-068c-469f-8d97-d584969c2b0f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:49.774900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce724c72-068c-469f-8d97-d584969c2b0f None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:49.776445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 497/995] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:49.781537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae819ca-1e78-40bd-aec8-81f508408976 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:49.781825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae819ca-1e78-40bd-aec8-81f508408976 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:49.782652 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae819ca-1e78-40bd-aec8-81f508408976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:49.798862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3ae819ca-1e78-40bd-aec8-81f508408976 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:49.800061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3ae819ca-1e78-40bd-aec8-81f508408976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:49.816583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941689ef-e3a1-41bf-aa06-bf9751280a52 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:49.816904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941689ef-e3a1-41bf-aa06-bf9751280a52 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:49.817156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941689ef-e3a1-41bf-aa06-bf9751280a52 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:49.818545 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 498/996] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:49.823539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979d00-83f5-4805-b8e8-c43794c1dfef None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:49.823884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979d00-83f5-4805-b8e8-c43794c1dfef None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:49.824170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979d00-83f5-4805-b8e8-c43794c1dfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:49.841175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-85979d00-83f5-4805-b8e8-c43794c1dfef None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:49.842365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-85979d00-83f5-4805-b8e8-c43794c1dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:49.871465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 499/997] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:49.891079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae819ca-1e78-40bd-aec8-81f508408976 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:49.910929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 499/998] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:49.934158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85979d00-83f5-4805-b8e8-c43794c1dfef None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:49.999876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae819ca-1e78-40bd-aec8-81f508408976 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:50.040730 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d00e83-63a9-4d46-b5a2-48d695852ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:50.041371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d00e83-63a9-4d46-b5a2-48d695852ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:50.041653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d00e83-63a9-4d46-b5a2-48d695852ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:50.041929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d00e83-63a9-4d46-b5a2-48d695852ac6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:50.042671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d00e83-63a9-4d46-b5a2-48d695852ac6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:50.044097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d00e83-63a9-4d46-b5a2-48d695852ac6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:50.049514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85979d00-83f5-4805-b8e8-c43794c1dfef None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-67d00e83-63a9-4d46-b5a2-48d695852ac6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:50.056003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:50.056978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:50.057850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 500/999] 10.222.0.64 () {56 vars in 1126 bytes} [Fri May 13 17:08:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:50.063245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d00e83-63a9-4d46-b5a2-48d695852ac6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:50.092989 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa260b-5c38-452c-943f-daadddccd01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:50.093953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa260b-5c38-452c-943f-daadddccd01a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:50.094607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa260b-5c38-452c-943f-daadddccd01a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:50.095410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa260b-5c38-452c-943f-daadddccd01a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:50.099384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa260b-5c38-452c-943f-daadddccd01a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:50.099384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa260b-5c38-452c-943f-daadddccd01a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-cdaa260b-5c38-452c-943f-daadddccd01a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:50.112949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:50.114010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 17:08:50.114855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:50.116505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 500/1000] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:50.119916 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa260b-5c38-452c-943f-daadddccd01a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:50.165963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d00e83-63a9-4d46-b5a2-48d695852ac6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:50.198906 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1c5c3-8156-4353-a870-0272ea105683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:50.199873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1c5c3-8156-4353-a870-0272ea105683 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:50.200164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1c5c3-8156-4353-a870-0272ea105683 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:50.200438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1c5c3-8156-4353-a870-0272ea105683 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:50.201140 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1c5c3-8156-4353-a870-0272ea105683 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:50.201442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1c5c3-8156-4353-a870-0272ea105683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:50.202822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1c5c3-8156-4353-a870-0272ea105683 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:50.208272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 501/1001] 10.222.0.64 () {56 vars in 1122 bytes} [Fri May 13 17:08:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:50.213712 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1c5c3-8156-4353-a870-0272ea105683 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:50.226149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa260b-5c38-452c-943f-daadddccd01a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:50.259411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793e2df-4503-4549-93fc-d57d93081cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:50.260075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793e2df-4503-4549-93fc-d57d93081cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:50.260356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793e2df-4503-4549-93fc-d57d93081cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:50.260631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793e2df-4503-4549-93fc-d57d93081cc6 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:50.261338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793e2df-4503-4549-93fc-d57d93081cc6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:50.261643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793e2df-4503-4549-93fc-d57d93081cc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:50.263028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793e2df-4503-4549-93fc-d57d93081cc6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:50.268391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 501/1002] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:50.273843 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793e2df-4503-4549-93fc-d57d93081cc6 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:50.316165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1c5c3-8156-4353-a870-0272ea105683 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:50.349336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac05e0-9b55-46b8-896c-2ac69e53b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:50.349998 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac05e0-9b55-46b8-896c-2ac69e53b945 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:50.350278 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac05e0-9b55-46b8-896c-2ac69e53b945 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:50.350552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac05e0-9b55-46b8-896c-2ac69e53b945 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:50.351292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac05e0-9b55-46b8-896c-2ac69e53b945 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:50.351600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac05e0-9b55-46b8-896c-2ac69e53b945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:50.353017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac05e0-9b55-46b8-896c-2ac69e53b945 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:50.358361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 502/1003] 10.222.0.64 () {56 vars in 1122 bytes} [Fri May 13 17:08:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:50.364151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac05e0-9b55-46b8-896c-2ac69e53b945 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:50.376499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793e2df-4503-4549-93fc-d57d93081cc6 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:50.409342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21599a-2003-4dd2-a192-2e80271af181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:50.410003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21599a-2003-4dd2-a192-2e80271af181 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:50.410285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21599a-2003-4dd2-a192-2e80271af181 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:50.410558 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21599a-2003-4dd2-a192-2e80271af181 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:50.411297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21599a-2003-4dd2-a192-2e80271af181 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:50.411604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21599a-2003-4dd2-a192-2e80271af181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:50.412977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21599a-2003-4dd2-a192-2e80271af181 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:50.417642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 502/1004] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:50.423523 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21599a-2003-4dd2-a192-2e80271af181 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:50.472267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac05e0-9b55-46b8-896c-2ac69e53b945 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:50.505636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d07a2-1bff-4ba7-946b-0f4c4d2e8c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:50.506304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d07a2-1bff-4ba7-946b-0f4c4d2e8c73 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:50.506593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d07a2-1bff-4ba7-946b-0f4c4d2e8c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:50.506858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d07a2-1bff-4ba7-946b-0f4c4d2e8c73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:50.507628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d07a2-1bff-4ba7-946b-0f4c4d2e8c73 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:50.509015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d07a2-1bff-4ba7-946b-0f4c4d2e8c73 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:50.524044 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21599a-2003-4dd2-a192-2e80271af181 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:50.557097 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f59c0-5c59-4d91-a01b-6b664a0fc71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:50.557755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f59c0-5c59-4d91-a01b-6b664a0fc71e None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:50.558042 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f59c0-5c59-4d91-a01b-6b664a0fc71e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:50.558322 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f59c0-5c59-4d91-a01b-6b664a0fc71e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:50.559110 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f59c0-5c59-4d91-a01b-6b664a0fc71e None admin] RBAC: Adding query filter params (interface=public, service_id=82e86faaf2694cf5ad45d6ed3d8d1fb3, region_id=RegionOne) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:50.559456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f59c0-5c59-4d91-a01b-6b664a0fc71e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:50.560839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f59c0-5c59-4d91-a01b-6b664a0fc71e None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:50.566526 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 503/1005] 10.222.0.64 () {56 vars in 1251 bytes} [Fri May 13 17:08:50 2022] GET /identity/v3/endpoints?service_id=82e86faaf2694cf5ad45d6ed3d8d1fb3&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:50.571850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f59c0-5c59-4d91-a01b-6b664a0fc71e None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:50.581844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 503/1006] 10.222.0.64 () {60 vars in 1144 bytes} [Fri May 13 17:08:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:08:50.677182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f59c0-5c59-4d91-a01b-6b664a0fc71e None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:50.718276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cb303-c043-4b25-a035-731455b5bc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:50.718961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cb303-c043-4b25-a035-731455b5bc75 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:50.719281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cb303-c043-4b25-a035-731455b5bc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:50.719593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cb303-c043-4b25-a035-731455b5bc75 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:50.720292 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cb303-c043-4b25-a035-731455b5bc75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:50.721683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cb303-c043-4b25-a035-731455b5bc75 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:50.735558 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 504/1007] 10.222.0.64 () {56 vars in 1087 bytes} [Fri May 13 17:08:50 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:08:51.619297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7b1b-59a1-4c51-8e09-1092e1e0a75e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:51.619817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7b1b-59a1-4c51-8e09-1092e1e0a75e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:51.619893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7b1b-59a1-4c51-8e09-1092e1e0a75e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:51.621236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 504/1008] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:51.626882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cdd9c-8e47-4da6-a51b-56c8941b17fb None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:51.627346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cdd9c-8e47-4da6-a51b-56c8941b17fb None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:51.627490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cdd9c-8e47-4da6-a51b-56c8941b17fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:51.644361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-de5cdd9c-8e47-4da6-a51b-56c8941b17fb None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:51.645523 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-de5cdd9c-8e47-4da6-a51b-56c8941b17fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:51.708111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 505/1009] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:51.730567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a7b1b-59a1-4c51-8e09-1092e1e0a75e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:51.827917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a7b1b-59a1-4c51-8e09-1092e1e0a75e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:51.862972 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74b8d7-355e-47fa-92ca-cbe3794535a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:51.863679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b8d7-355e-47fa-92ca-cbe3794535a3 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:51.863958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b8d7-355e-47fa-92ca-cbe3794535a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:51.864227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b8d7-355e-47fa-92ca-cbe3794535a3 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:51.864947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74b8d7-355e-47fa-92ca-cbe3794535a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:51.866335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74b8d7-355e-47fa-92ca-cbe3794535a3 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:51.945094 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 505/1010] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:08:51 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:08:52.836643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9106819-3b33-4efb-86ec-da2d9bfbfa76 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:52.837195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9106819-3b33-4efb-86ec-da2d9bfbfa76 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:52.837195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9106819-3b33-4efb-86ec-da2d9bfbfa76 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:52.838568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 506/1011] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:52.843971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1c1c9-dc5e-4019-9ac7-e52e17e041bd None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:52.844368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1c1c9-dc5e-4019-9ac7-e52e17e041bd None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:52.845199 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1c1c9-dc5e-4019-9ac7-e52e17e041bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:52.861373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a9d1c1c9-dc5e-4019-9ac7-e52e17e041bd None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:52.862540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a9d1c1c9-dc5e-4019-9ac7-e52e17e041bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:52.930835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 506/1012] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:52 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:52.947909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a64c-6cd0-4664-b1c2-52fb86498441 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:52.948203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a64c-6cd0-4664-b1c2-52fb86498441 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:52.948482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967a64c-6cd0-4664-b1c2-52fb86498441 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:52.950262 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 507/1013] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:52.953318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1c1c9-dc5e-4019-9ac7-e52e17e041bd None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:52.956811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de487bed-9db9-45b4-a25b-6b92e4e122d0 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:52.956811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de487bed-9db9-45b4-a25b-6b92e4e122d0 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:52.956811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de487bed-9db9-45b4-a25b-6b92e4e122d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:52.974690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-de487bed-9db9-45b4-a25b-6b92e4e122d0 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:52.975924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-de487bed-9db9-45b4-a25b-6b92e4e122d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:53.051293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 508/1014] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:52 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:53.058015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1c1c9-dc5e-4019-9ac7-e52e17e041bd None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:53.072440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de487bed-9db9-45b4-a25b-6b92e4e122d0 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:53.093273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dd00b-7842-49af-84a7-d965464f93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:53.093996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd00b-7842-49af-84a7-d965464f93ef None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:53.094279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd00b-7842-49af-84a7-d965464f93ef None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:53.095118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dd00b-7842-49af-84a7-d965464f93ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:53.096322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dd00b-7842-49af-84a7-d965464f93ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:53.097788 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dd00b-7842-49af-84a7-d965464f93ef None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:53.099602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 507/1015] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:53.104904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dd00b-7842-49af-84a7-d965464f93ef None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:53.184277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de487bed-9db9-45b4-a25b-6b92e4e122d0 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:53.203873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dd00b-7842-49af-84a7-d965464f93ef None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:53.218180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d44e32-c5cb-40ae-ac14-90e35ffe744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:53.218973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d44e32-c5cb-40ae-ac14-90e35ffe744a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:53.219290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d44e32-c5cb-40ae-ac14-90e35ffe744a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:53.219601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d44e32-c5cb-40ae-ac14-90e35ffe744a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:53.220265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d44e32-c5cb-40ae-ac14-90e35ffe744a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:53.221649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d44e32-c5cb-40ae-ac14-90e35ffe744a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-e2d44e32-c5cb-40ae-ac14-90e35ffe744a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:53.233296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:53.234310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:53.235665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 509/1016] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:53.238992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a57dc-4730-4d43-b54d-ef197f8c9250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:53.240361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d44e32-c5cb-40ae-ac14-90e35ffe744a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:53.240985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a57dc-4730-4d43-b54d-ef197f8c9250 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:53.241265 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a57dc-4730-4d43-b54d-ef197f8c9250 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:53.241537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a57dc-4730-4d43-b54d-ef197f8c9250 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:53.242241 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a57dc-4730-4d43-b54d-ef197f8c9250 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:53.243726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a57dc-4730-4d43-b54d-ef197f8c9250 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:53.333824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 508/1017] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:08:53 2022] POST /identity/v3/projects => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:08:53.338009 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d44e32-c5cb-40ae-ac14-90e35ffe744a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:53.373349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2e9ce-bc9b-43b3-ab9e-b62bbe3d4aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:53.374034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2e9ce-bc9b-43b3-ab9e-b62bbe3d4aac None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:53.374313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2e9ce-bc9b-43b3-ab9e-b62bbe3d4aac None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:53.374583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2e9ce-bc9b-43b3-ab9e-b62bbe3d4aac None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:53.375335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2e9ce-bc9b-43b3-ab9e-b62bbe3d4aac None admin] RBAC: Adding query filter params (name=compute) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:53.376165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2e9ce-bc9b-43b3-ab9e-b62bbe3d4aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:53.377586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2e9ce-bc9b-43b3-ab9e-b62bbe3d4aac None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:53.387543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 510/1018] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:53.389118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a57dc-4730-4d43-b54d-ef197f8c9250 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:53.493509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a57dc-4730-4d43-b54d-ef197f8c9250 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:53.527934 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17faca8-928a-4baf-9c6b-c0028f780dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:53.528602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17faca8-928a-4baf-9c6b-c0028f780dec None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:53.528886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17faca8-928a-4baf-9c6b-c0028f780dec None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:53.529160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17faca8-928a-4baf-9c6b-c0028f780dec None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:53.529862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17faca8-928a-4baf-9c6b-c0028f780dec None admin] RBAC: Adding query filter params (type=compute) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:53.530164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17faca8-928a-4baf-9c6b-c0028f780dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:53.531613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17faca8-928a-4baf-9c6b-c0028f780dec None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:53.536673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 509/1019] 10.222.0.64 () {56 vars in 1112 bytes} [Fri May 13 17:08:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:53.542521 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2e9ce-bc9b-43b3-ab9e-b62bbe3d4aac None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:53.654861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2e9ce-bc9b-43b3-ab9e-b62bbe3d4aac None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:53.687517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8a473-82e0-48bc-b68f-d0f231133040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:53.689032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8a473-82e0-48bc-b68f-d0f231133040 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:53.689530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8a473-82e0-48bc-b68f-d0f231133040 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:53.690008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8a473-82e0-48bc-b68f-d0f231133040 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:53.690942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8a473-82e0-48bc-b68f-d0f231133040 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:53.692529 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8a473-82e0-48bc-b68f-d0f231133040 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:53.777618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 511/1020] 10.222.0.64 () {60 vars in 1144 bytes} [Fri May 13 17:08:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:08:54.209276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bea8b-95a0-4725-b15a-6105a28cbecd None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:54.209793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bea8b-95a0-4725-b15a-6105a28cbecd None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:54.209871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bea8b-95a0-4725-b15a-6105a28cbecd None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:54.211374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 510/1021] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:54.218276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff9386-568a-431c-becf-250bc4e92938 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:54.218764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff9386-568a-431c-becf-250bc4e92938 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:54.218844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff9386-568a-431c-becf-250bc4e92938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:54.240409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d8ff9386-568a-431c-becf-250bc4e92938 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:54.241922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d8ff9386-568a-431c-becf-250bc4e92938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:54.319280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 512/1022] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:54.337364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bea8b-95a0-4725-b15a-6105a28cbecd None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:54.441195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bea8b-95a0-4725-b15a-6105a28cbecd None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:54.476613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12264e4c-1170-4e3c-aa7b-865f649ca379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:54.477796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12264e4c-1170-4e3c-aa7b-865f649ca379 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:54.478322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12264e4c-1170-4e3c-aa7b-865f649ca379 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:54.478825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12264e4c-1170-4e3c-aa7b-865f649ca379 None admin] PATH_INFO: `/v3/services/image` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:54.479743 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12264e4c-1170-4e3c-aa7b-865f649ca379 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:54.481457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12264e4c-1170-4e3c-aa7b-865f649ca379 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-12264e4c-1170-4e3c-aa7b-865f649ca379 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:54.494508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:54.495626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 17:08:54.496486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:54.503299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 511/1023] 10.222.0.64 () {56 vars in 1105 bytes} [Fri May 13 17:08:54 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:54.504543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff9386-568a-431c-becf-250bc4e92938 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:54.614430 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff9386-568a-431c-becf-250bc4e92938 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:54.652183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b486b-3f19-4ca9-b1d7-ff85a755fc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:54.653284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b486b-3f19-4ca9-b1d7-ff85a755fc90 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:54.653768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b486b-3f19-4ca9-b1d7-ff85a755fc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:54.654241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b486b-3f19-4ca9-b1d7-ff85a755fc90 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:54.655165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b486b-3f19-4ca9-b1d7-ff85a755fc90 None admin] RBAC: Adding query filter params (name=image) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:54.655698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b486b-3f19-4ca9-b1d7-ff85a755fc90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:54.657914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b486b-3f19-4ca9-b1d7-ff85a755fc90 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:54.663473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 513/1024] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:54.669711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12264e4c-1170-4e3c-aa7b-865f649ca379 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:54.769907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12264e4c-1170-4e3c-aa7b-865f649ca379 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:54.803315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b64f13-2311-426c-ad7e-b37beb693f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:54.803969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b64f13-2311-426c-ad7e-b37beb693f9b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:54.804303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b64f13-2311-426c-ad7e-b37beb693f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:54.804575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b64f13-2311-426c-ad7e-b37beb693f9b None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:54.805313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b64f13-2311-426c-ad7e-b37beb693f9b None admin] RBAC: Adding query filter params (type=image) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:54.805616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b64f13-2311-426c-ad7e-b37beb693f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:54.806988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b64f13-2311-426c-ad7e-b37beb693f9b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:54.812724 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 512/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:54.817765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b486b-3f19-4ca9-b1d7-ff85a755fc90 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:54.910035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b486b-3f19-4ca9-b1d7-ff85a755fc90 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:54.941899 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10ee95-8e95-4dd7-a66b-e91ea5972f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:54.942550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ee95-8e95-4dd7-a66b-e91ea5972f3b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:54.942832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ee95-8e95-4dd7-a66b-e91ea5972f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:54.943106 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ee95-8e95-4dd7-a66b-e91ea5972f3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:54.943935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ee95-8e95-4dd7-a66b-e91ea5972f3b None admin] RBAC: Adding query filter params (interface=public, service_id=7397103bf3594417925c49c79a02ee4a, region_id=RegionOne) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:54.944244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ee95-8e95-4dd7-a66b-e91ea5972f3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:54.945607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ee95-8e95-4dd7-a66b-e91ea5972f3b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:54.956883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 514/1026] 10.222.0.64 () {56 vars in 1251 bytes} [Fri May 13 17:08:54 2022] GET /identity/v3/endpoints?service_id=7397103bf3594417925c49c79a02ee4a&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:54.957038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b64f13-2311-426c-ad7e-b37beb693f9b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:55.061286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b64f13-2311-426c-ad7e-b37beb693f9b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:55.094451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce1504-a4d3-4e30-b0df-5ee3eea51f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:55.095656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1504-a4d3-4e30-b0df-5ee3eea51f1f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:55.095940 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1504-a4d3-4e30-b0df-5ee3eea51f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:55.096213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1504-a4d3-4e30-b0df-5ee3eea51f1f None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:55.096891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce1504-a4d3-4e30-b0df-5ee3eea51f1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:55.098277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce1504-a4d3-4e30-b0df-5ee3eea51f1f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:55.111166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 513/1027] 10.222.0.64 () {56 vars in 1087 bytes} [Fri May 13 17:08:54 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:08:55.633266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126ef4d-2f6e-45d6-9609-f236c78d247e None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:55.633833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126ef4d-2f6e-45d6-9609-f236c78d247e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:55.633833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126ef4d-2f6e-45d6-9609-f236c78d247e None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:55.635261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 515/1028] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:55.640488 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114cd9-f9cc-4c8f-a910-9dc7c428fc02 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:55.640924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114cd9-f9cc-4c8f-a910-9dc7c428fc02 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:55.641069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114cd9-f9cc-4c8f-a910-9dc7c428fc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:55.658636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6a114cd9-f9cc-4c8f-a910-9dc7c428fc02 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:55.659841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6a114cd9-f9cc-4c8f-a910-9dc7c428fc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:55.726023 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 514/1029] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:55.750197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126ef4d-2f6e-45d6-9609-f236c78d247e None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:55.847612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126ef4d-2f6e-45d6-9609-f236c78d247e None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:55.884834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42004ead-d6f5-4971-a8cd-8a9ba56346d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:55.885547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42004ead-d6f5-4971-a8cd-8a9ba56346d9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:55.885825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42004ead-d6f5-4971-a8cd-8a9ba56346d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:55.886097 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42004ead-d6f5-4971-a8cd-8a9ba56346d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:55.887281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42004ead-d6f5-4971-a8cd-8a9ba56346d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:55.888717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42004ead-d6f5-4971-a8cd-8a9ba56346d9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:55.894940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 516/1030] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:55.896158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a114cd9-f9cc-4c8f-a910-9dc7c428fc02 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:56.001999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a114cd9-f9cc-4c8f-a910-9dc7c428fc02 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:56.034056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd025f-39a3-47b5-aa5e-12578fc594e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:56.034737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd025f-39a3-47b5-aa5e-12578fc594e6 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:56.035018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd025f-39a3-47b5-aa5e-12578fc594e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:56.035318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd025f-39a3-47b5-aa5e-12578fc594e6 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:56.036044 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd025f-39a3-47b5-aa5e-12578fc594e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:56.037626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd025f-39a3-47b5-aa5e-12578fc594e6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:56.098470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70479-70b8-4195-9628-55db8a127cc4 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:56.098470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70479-70b8-4195-9628-55db8a127cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:56.098470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d70479-70b8-4195-9628-55db8a127cc4 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:56.098470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 517/1031] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:56.103340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8468f7-0e05-4d21-855f-612117f50116 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:56.103634 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8468f7-0e05-4d21-855f-612117f50116 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:56.103914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8468f7-0e05-4d21-855f-612117f50116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:56.121149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-1f8468f7-0e05-4d21-855f-612117f50116 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:56.122522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-1f8468f7-0e05-4d21-855f-612117f50116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:56.129945 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 515/1032] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:08:55 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:08:56.217941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 518/1033] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:56.242244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd025f-39a3-47b5-aa5e-12578fc594e6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:56.345106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd025f-39a3-47b5-aa5e-12578fc594e6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:56.378194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93730046-a273-4db2-b897-b01d2d0b9806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:56.379065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730046-a273-4db2-b897-b01d2d0b9806 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:56.379373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730046-a273-4db2-b897-b01d2d0b9806 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:56.379648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730046-a273-4db2-b897-b01d2d0b9806 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:56.390413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93730046-a273-4db2-b897-b01d2d0b9806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-93730046-a273-4db2-b897-b01d2d0b9806 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:56.398691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:56.399731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:56.400584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 516/1034] 10.222.0.64 () {56 vars in 1120 bytes} [Fri May 13 17:08:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:56.405860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8468f7-0e05-4d21-855f-612117f50116 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:56.500760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8468f7-0e05-4d21-855f-612117f50116 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:56.538650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5183c-6001-441b-9e26-3fc7348b49c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:56.539353 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5183c-6001-441b-9e26-3fc7348b49c2 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:56.539639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5183c-6001-441b-9e26-3fc7348b49c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:56.539914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5183c-6001-441b-9e26-3fc7348b49c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:56.540670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5183c-6001-441b-9e26-3fc7348b49c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:56.540978 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5183c-6001-441b-9e26-3fc7348b49c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:56.542348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5183c-6001-441b-9e26-3fc7348b49c2 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:56.554936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 519/1035] 10.222.0.64 () {56 vars in 1115 bytes} [Fri May 13 17:08:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:56.556163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93730046-a273-4db2-b897-b01d2d0b9806 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:56.652617 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93730046-a273-4db2-b897-b01d2d0b9806 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:56.684665 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066eab4-c5d5-495b-8323-bc6243470ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:56.685463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066eab4-c5d5-495b-8323-bc6243470ecf None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:56.685792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066eab4-c5d5-495b-8323-bc6243470ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:56.686071 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066eab4-c5d5-495b-8323-bc6243470ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:56.696397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066eab4-c5d5-495b-8323-bc6243470ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:56.697858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066eab4-c5d5-495b-8323-bc6243470ecf None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-f066eab4-c5d5-495b-8323-bc6243470ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:56.716054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:56.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:56.718270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:56.718270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:56.718270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:56.718270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:56.724961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 517/1036] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:56.726287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5183c-6001-441b-9e26-3fc7348b49c2 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:56.826678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5183c-6001-441b-9e26-3fc7348b49c2 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:56.858786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2da6eb-c895-4391-87bf-ad8497095131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:56.859476 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2da6eb-c895-4391-87bf-ad8497095131 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:56.859757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2da6eb-c895-4391-87bf-ad8497095131 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:56.860028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2da6eb-c895-4391-87bf-ad8497095131 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:56.860743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2da6eb-c895-4391-87bf-ad8497095131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:56.861043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2da6eb-c895-4391-87bf-ad8497095131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:56.862409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2da6eb-c895-4391-87bf-ad8497095131 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:56.878735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 520/1037] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:56.880428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066eab4-c5d5-495b-8323-bc6243470ecf None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:56.981222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066eab4-c5d5-495b-8323-bc6243470ecf None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:57.015091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaf343-dd86-4873-bc3b-624cffa450c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:57.015904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaf343-dd86-4873-bc3b-624cffa450c5 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:57.016207 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaf343-dd86-4873-bc3b-624cffa450c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:57.025526 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaf343-dd86-4873-bc3b-624cffa450c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:57.025526 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaf343-dd86-4873-bc3b-624cffa450c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:57.026169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaf343-dd86-4873-bc3b-624cffa450c5 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-6ffaf343-dd86-4873-bc3b-624cffa450c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:08:57.040675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:57.041648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:57.042595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:57.042595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:57.042595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:08:57.042595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:08:57.042595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:08:57.042595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:08:57.042595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:08:57.042595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:08:57.042595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 17:08:57.042595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:57.046608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 518/1038] 10.222.0.64 () {56 vars in 1093 bytes} [Fri May 13 17:08:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:57.047518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2da6eb-c895-4391-87bf-ad8497095131 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:57.142661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2da6eb-c895-4391-87bf-ad8497095131 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:57.174735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc7293-e325-4a3e-aa74-f7ed3d530d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:57.175426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7293-e325-4a3e-aa74-f7ed3d530d5d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:57.175706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7293-e325-4a3e-aa74-f7ed3d530d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:57.175977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7293-e325-4a3e-aa74-f7ed3d530d5d None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:57.176803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc7293-e325-4a3e-aa74-f7ed3d530d5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:57.177103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc7293-e325-4a3e-aa74-f7ed3d530d5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:57.178532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc7293-e325-4a3e-aa74-f7ed3d530d5d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:57.197080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 521/1039] 10.222.0.64 () {56 vars in 1133 bytes} [Fri May 13 17:08:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:57.202985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaf343-dd86-4873-bc3b-624cffa450c5 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:57.299525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaf343-dd86-4873-bc3b-624cffa450c5 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:57.333394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8101879-91dc-4500-b59e-a8ad25a612b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:57.334044 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101879-91dc-4500-b59e-a8ad25a612b0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:57.334321 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101879-91dc-4500-b59e-a8ad25a612b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:57.334592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101879-91dc-4500-b59e-a8ad25a612b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:57.385466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d294784-65dc-4ed0-a665-fdecdf0db66f None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:57.385764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d294784-65dc-4ed0-a665-fdecdf0db66f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:57.386048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d294784-65dc-4ed0-a665-fdecdf0db66f None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:57.387469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 522/1040] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:08:57.392838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54abe92-2c42-44f6-85a7-ef88bd692b1a None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:57.393082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54abe92-2c42-44f6-85a7-ef88bd692b1a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:57.393413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54abe92-2c42-44f6-85a7-ef88bd692b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:57.400472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8101879-91dc-4500-b59e-a8ad25a612b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:57.402000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8101879-91dc-4500-b59e-a8ad25a612b0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:57.411119 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d54abe92-2c42-44f6-85a7-ef88bd692b1a None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:57.412394 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d54abe92-2c42-44f6-85a7-ef88bd692b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:57.477818 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 523/1041] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:08:57.499383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 519/1042] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:08:57.501508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54abe92-2c42-44f6-85a7-ef88bd692b1a None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:57.503432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8101879-91dc-4500-b59e-a8ad25a612b0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:57.601725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54abe92-2c42-44f6-85a7-ef88bd692b1a None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:57.607193 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8101879-91dc-4500-b59e-a8ad25a612b0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:57.636726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd23ca1-f75f-4df1-bf45-c71022227496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:57.638056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd23ca1-f75f-4df1-bf45-c71022227496 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:57.638572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd23ca1-f75f-4df1-bf45-c71022227496 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:57.639073 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd23ca1-f75f-4df1-bf45-c71022227496 None admin] PATH_INFO: `/v3/services/image` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:57.640324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd23ca1-f75f-4df1-bf45-c71022227496 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:57.643039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd23ca1-f75f-4df1-bf45-c71022227496 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:57.644136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c59825-35fe-4304-afed-5f775636c93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:57.645112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c59825-35fe-4304-afed-5f775636c93a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:57.645535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c59825-35fe-4304-afed-5f775636c93a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:57.645948 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c59825-35fe-4304-afed-5f775636c93a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:57.656130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c59825-35fe-4304-afed-5f775636c93a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-4fd23ca1-f75f-4df1-bf45-c71022227496 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:57.658143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:57.659117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 17:08:57.660002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:57.660753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c59825-35fe-4304-afed-5f775636c93a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:57.660824 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 524/1043] 10.222.0.64 () {56 vars in 1105 bytes} [Fri May 13 17:08:57 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:57.665269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd23ca1-f75f-4df1-bf45-c71022227496 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-04c59825-35fe-4304-afed-5f775636c93a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:08:57.678433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:57.685697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:57.689177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:08:57.689177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:08:57.689177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:08:57.689177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:57.689177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 520/1044] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:57.689177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c59825-35fe-4304-afed-5f775636c93a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:57.767207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd23ca1-f75f-4df1-bf45-c71022227496 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:57.782326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c59825-35fe-4304-afed-5f775636c93a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:57.803329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c25dce-5aee-4589-8258-5b400e73030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:57.803992 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25dce-5aee-4589-8258-5b400e73030e None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:57.804273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25dce-5aee-4589-8258-5b400e73030e None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:57.804548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c25dce-5aee-4589-8258-5b400e73030e None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:57.805250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c25dce-5aee-4589-8258-5b400e73030e None admin] RBAC: Adding query filter params (name=image) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:57.805556 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c25dce-5aee-4589-8258-5b400e73030e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:57.806915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c25dce-5aee-4589-8258-5b400e73030e None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:57.816283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 525/1045] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:57.818010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c25dce-5aee-4589-8258-5b400e73030e None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:57.821771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7648d4-101b-4041-9e7a-966e26b3040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:57.822431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7648d4-101b-4041-9e7a-966e26b3040a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:57.822706 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7648d4-101b-4041-9e7a-966e26b3040a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:57.822971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7648d4-101b-4041-9e7a-966e26b3040a None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:57.823707 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7648d4-101b-4041-9e7a-966e26b3040a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:57.824006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7648d4-101b-4041-9e7a-966e26b3040a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:57.825640 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7648d4-101b-4041-9e7a-966e26b3040a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:57.838568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 521/1046] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:57.843969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7648d4-101b-4041-9e7a-966e26b3040a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:57.920058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c25dce-5aee-4589-8258-5b400e73030e None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:57.951250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7648d4-101b-4041-9e7a-966e26b3040a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:57.959568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f9e21-a23c-403f-a356-060f161419c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:57.960257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f9e21-a23c-403f-a356-060f161419c9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:57.960540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f9e21-a23c-403f-a356-060f161419c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:57.960822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f9e21-a23c-403f-a356-060f161419c9 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:57.961537 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f9e21-a23c-403f-a356-060f161419c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:57.961845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f9e21-a23c-403f-a356-060f161419c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:57.963259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f9e21-a23c-403f-a356-060f161419c9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:57.973643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 526/1047] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:08:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:57.974388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f9e21-a23c-403f-a356-060f161419c9 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:57.987623 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6631833-e352-4b77-98ca-bd83689bad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:57.988484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6631833-e352-4b77-98ca-bd83689bad2f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:57.993150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6631833-e352-4b77-98ca-bd83689bad2f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:57.993150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6631833-e352-4b77-98ca-bd83689bad2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:57.996244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6631833-e352-4b77-98ca-bd83689bad2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:57.998133 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6631833-e352-4b77-98ca-bd83689bad2f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-f6631833-e352-4b77-98ca-bd83689bad2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:08:58.012181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:58.013226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:58.014136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:08:58.014136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:08:58.014136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:08:58.014136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:08:58.014136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:08:58.014136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:08:58.014136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:08:58.014136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:08:58.014136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 522/1048] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:08:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:08:58.020325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6631833-e352-4b77-98ca-bd83689bad2f None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:58.082917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f9e21-a23c-403f-a356-060f161419c9 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:58.115647 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6631833-e352-4b77-98ca-bd83689bad2f None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:58.118303 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1568f5-d732-4132-a633-16270e8b6e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:58.119077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1568f5-d732-4132-a633-16270e8b6e4b None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:58.119410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1568f5-d732-4132-a633-16270e8b6e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:58.119694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1568f5-d732-4132-a633-16270e8b6e4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:58.120436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1568f5-d732-4132-a633-16270e8b6e4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:58.121816 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1568f5-d732-4132-a633-16270e8b6e4b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:58.148407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e445cb-2ae5-4ae4-a6d4-9832f1b8cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:58.149062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e445cb-2ae5-4ae4-a6d4-9832f1b8cf69 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:58.149340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e445cb-2ae5-4ae4-a6d4-9832f1b8cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:58.149613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e445cb-2ae5-4ae4-a6d4-9832f1b8cf69 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:58.150386 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e445cb-2ae5-4ae4-a6d4-9832f1b8cf69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:58.150696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e445cb-2ae5-4ae4-a6d4-9832f1b8cf69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:58.152241 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e445cb-2ae5-4ae4-a6d4-9832f1b8cf69 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:58.163978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 523/1049] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:58.170011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e445cb-2ae5-4ae4-a6d4-9832f1b8cf69 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:58.215239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 527/1050] 10.222.0.64 () {60 vars in 1144 bytes} [Fri May 13 17:08:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:08:58.277777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e445cb-2ae5-4ae4-a6d4-9832f1b8cf69 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:58.323397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad0252-b516-4987-b1b5-7257039f43a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:58.324067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0252-b516-4987-b1b5-7257039f43a0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:58.324348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0252-b516-4987-b1b5-7257039f43a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:58.324622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0252-b516-4987-b1b5-7257039f43a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:58.325715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad0252-b516-4987-b1b5-7257039f43a0 None admin] RBAC: Adding query filter params (role.id=b1d2c3a8bfec44aeacafbdc51013fad7, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=efbbecde248c44c7b1d5f3c9522a48a2) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:58.326024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad0252-b516-4987-b1b5-7257039f43a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:58.327529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad0252-b516-4987-b1b5-7257039f43a0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:58.339432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 524/1051] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:58 2022] GET /identity/v3/role_assignments?user.id=efbbecde248c44c7b1d5f3c9522a48a2&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=b1d2c3a8bfec44aeacafbdc51013fad7 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:58.481503 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170363e-8084-41f6-a7d3-06d08e3ec161 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:58.481804 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170363e-8084-41f6-a7d3-06d08e3ec161 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:58.481988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170363e-8084-41f6-a7d3-06d08e3ec161 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:58.483594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 528/1052] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:08:58.489733 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f883f9-e556-4084-9e89-5356c67f0d5b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:58.490021 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f883f9-e556-4084-9e89-5356c67f0d5b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:58.490304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f883f9-e556-4084-9e89-5356c67f0d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:58.507981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a7f883f9-e556-4084-9e89-5356c67f0d5b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:08:58.509182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a7f883f9-e556-4084-9e89-5356c67f0d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:08:58.576721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 525/1053] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:08:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:08:58.610884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170363e-8084-41f6-a7d3-06d08e3ec161 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:58.728641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170363e-8084-41f6-a7d3-06d08e3ec161 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:58.762808 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9162e90-9bbd-4119-84e5-046ecb98e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:58.763557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9162e90-9bbd-4119-84e5-046ecb98e0fa None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:58.763841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9162e90-9bbd-4119-84e5-046ecb98e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:58.764121 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9162e90-9bbd-4119-84e5-046ecb98e0fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:58.774604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9162e90-9bbd-4119-84e5-046ecb98e0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-d9162e90-9bbd-4119-84e5-046ecb98e0fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:08:58.782830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:08:58.783768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:08:58.784638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:08:58.787446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 529/1054] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:08:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:08:58.789989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f883f9-e556-4084-9e89-5356c67f0d5b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:58.894646 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f883f9-e556-4084-9e89-5356c67f0d5b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:58.927796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862fb46-9b93-4b50-b886-d8c2333c78ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:58.928825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862fb46-9b93-4b50-b886-d8c2333c78ba None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:58.929317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862fb46-9b93-4b50-b886-d8c2333c78ba None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:58.929814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862fb46-9b93-4b50-b886-d8c2333c78ba None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:58.930805 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862fb46-9b93-4b50-b886-d8c2333c78ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:58.931364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862fb46-9b93-4b50-b886-d8c2333c78ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:58.933036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862fb46-9b93-4b50-b886-d8c2333c78ba None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:58.942784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 526/1055] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:08:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:58.948084 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9162e90-9bbd-4119-84e5-046ecb98e0fa None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:59.059297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9162e90-9bbd-4119-84e5-046ecb98e0fa None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:59.094224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e1d3f-dd7d-40a0-81d6-2c6cecd7e7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:59.095444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e1d3f-dd7d-40a0-81d6-2c6cecd7e7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:59.095732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e1d3f-dd7d-40a0-81d6-2c6cecd7e7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:59.096070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e1d3f-dd7d-40a0-81d6-2c6cecd7e7a0 None admin] PATH_INFO: `/v3/users/7d8e24771a0b47808ec876de48851a59` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:59.110550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e1d3f-dd7d-40a0-81d6-2c6cecd7e7a0 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8e24771a0b47808ec876de48851a59)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:59.112116 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e1d3f-dd7d-40a0-81d6-2c6cecd7e7a0 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:59.118427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 530/1056] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:08:58 2022] GET /identity/v3/users/7d8e24771a0b47808ec876de48851a59 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:08:59.119792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862fb46-9b93-4b50-b886-d8c2333c78ba None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:59.219813 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862fb46-9b93-4b50-b886-d8c2333c78ba None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:59.252898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79c720-5214-4693-a3cc-2531e012fbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:59.253536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c720-5214-4693-a3cc-2531e012fbfb None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:59.253816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c720-5214-4693-a3cc-2531e012fbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:59.254085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c720-5214-4693-a3cc-2531e012fbfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:59.318790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79c720-5214-4693-a3cc-2531e012fbfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:59.320321 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79c720-5214-4693-a3cc-2531e012fbfb None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:59.421435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 527/1057] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:08:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:08:59.422904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e1d3f-dd7d-40a0-81d6-2c6cecd7e7a0 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:59.532688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e1d3f-dd7d-40a0-81d6-2c6cecd7e7a0 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:59.568564 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e64fa9-f570-44e0-8b5c-f547c9daba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:59.569487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64fa9-f570-44e0-8b5c-f547c9daba3b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:59.569721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64fa9-f570-44e0-8b5c-f547c9daba3b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:59.569997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64fa9-f570-44e0-8b5c-f547c9daba3b None admin] PATH_INFO: `/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:59.571227 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e64fa9-f570-44e0-8b5c-f547c9daba3b None admin] RBAC: Authorizing `identity:get_project(project_id=bd0bb3c91c2941f0a014bba6dd4e345b)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:59.572685 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e64fa9-f570-44e0-8b5c-f547c9daba3b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:59.574587 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 531/1058] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:08:59 2022] GET /identity/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:08:59.580778 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79c720-5214-4693-a3cc-2531e012fbfb None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:08:59.682388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79c720-5214-4693-a3cc-2531e012fbfb None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:08:59.716529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58137b6-0c51-496d-b3f6-b812eeec02bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:08:59.717193 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58137b6-0c51-496d-b3f6-b812eeec02bb None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:08:59.717472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58137b6-0c51-496d-b3f6-b812eeec02bb None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:08:59.717742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58137b6-0c51-496d-b3f6-b812eeec02bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:08:59.718653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58137b6-0c51-496d-b3f6-b812eeec02bb None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=bd0bb3c91c2941f0a014bba6dd4e345b, user.id=7d8e24771a0b47808ec876de48851a59) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:08:59.718978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58137b6-0c51-496d-b3f6-b812eeec02bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:08:59.720512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58137b6-0c51-496d-b3f6-b812eeec02bb None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:08:59.726066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 528/1059] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:08:59 2022] GET /identity/v3/role_assignments?user.id=7d8e24771a0b47808ec876de48851a59&scope.project.id=bd0bb3c91c2941f0a014bba6dd4e345b&role.id=2791519d9bad43318f086666b6e64a20 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:00.594224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808c2d-a2d2-48aa-9314-a079b5d1a5d6 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:00.594748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808c2d-a2d2-48aa-9314-a079b5d1a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:00.594858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808c2d-a2d2-48aa-9314-a079b5d1a5d6 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:00.596325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 532/1060] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:00.601631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066b73-e355-4bb2-a6d2-73b13e343796 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:00.602014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066b73-e355-4bb2-a6d2-73b13e343796 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:00.602191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066b73-e355-4bb2-a6d2-73b13e343796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:00.605846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a113f-2ef4-4647-a1f9-3051a0354f8b None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:00.606237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a113f-2ef4-4647-a1f9-3051a0354f8b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:00.606528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a113f-2ef4-4647-a1f9-3051a0354f8b None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:00.607878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 533/1061] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:09:00.613305 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef685-5b8b-4534-8d07-7022379915e5 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:00.613596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef685-5b8b-4534-8d07-7022379915e5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:00.613875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef685-5b8b-4534-8d07-7022379915e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:00.619881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b5066b73-e355-4bb2-a6d2-73b13e343796 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:00.621063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b5066b73-e355-4bb2-a6d2-73b13e343796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:00.630571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c70ef685-5b8b-4534-8d07-7022379915e5 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:00.631764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c70ef685-5b8b-4534-8d07-7022379915e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:00.687114 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 529/1062] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:00.696461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 534/1063] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:09:00.711868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5066b73-e355-4bb2-a6d2-73b13e343796 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:00.718234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ef685-5b8b-4534-8d07-7022379915e5 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:00.812087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5066b73-e355-4bb2-a6d2-73b13e343796 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:00.814799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ef685-5b8b-4534-8d07-7022379915e5 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:00.847832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a154-dfb6-4986-924d-b74f3484e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:00.848399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a154-dfb6-4986-924d-b74f3484e040 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:00.848726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a154-dfb6-4986-924d-b74f3484e040 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:00.848956 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a154-dfb6-4986-924d-b74f3484e040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:00.849331 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1cd97-4ff1-4824-a85f-729c174aaa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:00.850143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cd97-4ff1-4824-a85f-729c174aaa6c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:00.850422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cd97-4ff1-4824-a85f-729c174aaa6c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:00.850691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cd97-4ff1-4824-a85f-729c174aaa6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:00.861620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1cd97-4ff1-4824-a85f-729c174aaa6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-24a1cd97-4ff1-4824-a85f-729c174aaa6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:09:00.870306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:00.871266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:09:00.872144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 535/1064] 10.222.0.64 () {56 vars in 1120 bytes} [Fri May 13 17:09:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:09:00.877753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1cd97-4ff1-4824-a85f-729c174aaa6c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:00.918439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1a154-dfb6-4986-924d-b74f3484e040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:00.920339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1a154-dfb6-4986-924d-b74f3484e040 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:00.981721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1cd97-4ff1-4824-a85f-729c174aaa6c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:01.019997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 530/1065] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:09:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 17:09:01.023400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716b915-6719-4484-bf8a-e61683699216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:01.026528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716b915-6719-4484-bf8a-e61683699216 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:01.026528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716b915-6719-4484-bf8a-e61683699216 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:01.026528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716b915-6719-4484-bf8a-e61683699216 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:01.026528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716b915-6719-4484-bf8a-e61683699216 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:01.026817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a154-dfb6-4986-924d-b74f3484e040 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:01.026902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716b915-6719-4484-bf8a-e61683699216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:01.027052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716b915-6719-4484-bf8a-e61683699216 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:01.042921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 536/1066] 10.222.0.64 () {56 vars in 1115 bytes} [Fri May 13 17:09:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:01.043635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716b915-6719-4484-bf8a-e61683699216 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:01.125249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a154-dfb6-4986-924d-b74f3484e040 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:01.141924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716b915-6719-4484-bf8a-e61683699216 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:01.160751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b369864-67c5-4989-8406-c45cdc9243b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:01.161533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b369864-67c5-4989-8406-c45cdc9243b4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:01.161814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b369864-67c5-4989-8406-c45cdc9243b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:01.162091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b369864-67c5-4989-8406-c45cdc9243b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:01.171788 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b369864-67c5-4989-8406-c45cdc9243b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:01.173746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b369864-67c5-4989-8406-c45cdc9243b4 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:01.174756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efd3c0-4d8f-4b11-9543-f9094a861d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:01.175592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efd3c0-4d8f-4b11-9543-f9094a861d6d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:01.175876 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efd3c0-4d8f-4b11-9543-f9094a861d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:01.176157 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efd3c0-4d8f-4b11-9543-f9094a861d6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:01.186838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efd3c0-4d8f-4b11-9543-f9094a861d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:01.188872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efd3c0-4d8f-4b11-9543-f9094a861d6d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-2b369864-67c5-4989-8406-c45cdc9243b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:09:01.191468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:01.192344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:01.198177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:09:01.198177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:09:01.198177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:09:01.198177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:01.198177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 531/1067] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:09:01.198455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b369864-67c5-4989-8406-c45cdc9243b4 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-77efd3c0-4d8f-4b11-9543-f9094a861d6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:09:01.210736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:01.211683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:01.212576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:09:01.212576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:09:01.212576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:09:01.212576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:09:01.212576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 537/1068] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:01.217379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efd3c0-4d8f-4b11-9543-f9094a861d6d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:01.300826 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b369864-67c5-4989-8406-c45cdc9243b4 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:01.319281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efd3c0-4d8f-4b11-9543-f9094a861d6d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:01.339487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210041ed-264b-46e3-acbb-b47f88b81730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:01.340431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210041ed-264b-46e3-acbb-b47f88b81730 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:01.340713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210041ed-264b-46e3-acbb-b47f88b81730 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:01.340987 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210041ed-264b-46e3-acbb-b47f88b81730 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:01.342183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210041ed-264b-46e3-acbb-b47f88b81730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:01.342498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210041ed-264b-46e3-acbb-b47f88b81730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:01.344370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210041ed-264b-46e3-acbb-b47f88b81730 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:01.352263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7680ebe-c72a-4b1b-ba3b-d08b23d877f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:01.352923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7680ebe-c72a-4b1b-ba3b-d08b23d877f2 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:01.353217 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7680ebe-c72a-4b1b-ba3b-d08b23d877f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:01.353494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7680ebe-c72a-4b1b-ba3b-d08b23d877f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:01.354230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7680ebe-c72a-4b1b-ba3b-d08b23d877f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:01.354564 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7680ebe-c72a-4b1b-ba3b-d08b23d877f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:01.355955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7680ebe-c72a-4b1b-ba3b-d08b23d877f2 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:01.367577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 532/1069] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:01.368641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 538/1070] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:01.374358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210041ed-264b-46e3-acbb-b47f88b81730 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:01.479585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210041ed-264b-46e3-acbb-b47f88b81730 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:01.514554 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9642d-8e2f-44db-b37a-7f79703c86e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:01.515415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9642d-8e2f-44db-b37a-7f79703c86e3 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:01.515698 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9642d-8e2f-44db-b37a-7f79703c86e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:01.515974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9642d-8e2f-44db-b37a-7f79703c86e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:01.524518 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9642d-8e2f-44db-b37a-7f79703c86e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:01.526010 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9642d-8e2f-44db-b37a-7f79703c86e3 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-26e9642d-8e2f-44db-b37a-7f79703c86e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:09:01.541324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:01.542300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:01.543421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:01.543421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:01.543421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:09:01.543421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:09:01.543421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:09:01.543421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:09:01.543421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:09:01.543421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:09:01.543421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 17:09:01.543421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:01.543421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 533/1071] 10.222.0.64 () {56 vars in 1093 bytes} [Fri May 13 17:09:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:01.548779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7680ebe-c72a-4b1b-ba3b-d08b23d877f2 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:01.650141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7680ebe-c72a-4b1b-ba3b-d08b23d877f2 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:01.693121 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d357-d8b6-4300-86fe-505f630b6fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:01.693796 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d357-d8b6-4300-86fe-505f630b6fdd None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:01.694080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d357-d8b6-4300-86fe-505f630b6fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:01.694355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d357-d8b6-4300-86fe-505f630b6fdd None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:01.695229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296d357-d8b6-4300-86fe-505f630b6fdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:01.695542 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296d357-d8b6-4300-86fe-505f630b6fdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:01.696988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296d357-d8b6-4300-86fe-505f630b6fdd None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:01.714059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 539/1072] 10.222.0.64 () {56 vars in 1133 bytes} [Fri May 13 17:09:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:01.720158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9642d-8e2f-44db-b37a-7f79703c86e3 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:01.820862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9642d-8e2f-44db-b37a-7f79703c86e3 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:01.853349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601e8d3-195f-4750-b14b-77351eded9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:01.854136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e8d3-195f-4750-b14b-77351eded9fc None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:01.854414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e8d3-195f-4750-b14b-77351eded9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:01.854684 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e8d3-195f-4750-b14b-77351eded9fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:01.865248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601e8d3-195f-4750-b14b-77351eded9fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:01.866708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601e8d3-195f-4750-b14b-77351eded9fc None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-6601e8d3-195f-4750-b14b-77351eded9fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:09:01.883530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:01.884644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:01.885585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:09:01.885585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:09:01.885585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:09:01.885585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:01.885585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 534/1073] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:01.890332 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d357-d8b6-4300-86fe-505f630b6fdd None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:01.934096 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3486d-8c25-48a2-8939-43777e5bf83a None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:01.934383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3486d-8c25-48a2-8939-43777e5bf83a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:01.934661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3486d-8c25-48a2-8939-43777e5bf83a None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:01.936045 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 535/1074] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:09:01.941446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50cfcf-1008-40dc-9a64-066a73f1eead None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:01.941734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50cfcf-1008-40dc-9a64-066a73f1eead None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:01.942013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50cfcf-1008-40dc-9a64-066a73f1eead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:01.961263 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-aa50cfcf-1008-40dc-9a64-066a73f1eead None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:01.962475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-aa50cfcf-1008-40dc-9a64-066a73f1eead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:01.988464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d357-d8b6-4300-86fe-505f630b6fdd None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:02.021295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd8dc6-11cd-4bdd-96b0-7b939a077914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:02.021957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8dc6-11cd-4bdd-96b0-7b939a077914 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:02.022243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8dc6-11cd-4bdd-96b0-7b939a077914 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:02.024265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8dc6-11cd-4bdd-96b0-7b939a077914 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:02.024265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd8dc6-11cd-4bdd-96b0-7b939a077914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:02.024265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd8dc6-11cd-4bdd-96b0-7b939a077914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:02.025053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd8dc6-11cd-4bdd-96b0-7b939a077914 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:02.031812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 536/1075] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:09:02.041403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 540/1076] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:02.042811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50cfcf-1008-40dc-9a64-066a73f1eead None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:02.054445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd8dc6-11cd-4bdd-96b0-7b939a077914 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:02.136624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50cfcf-1008-40dc-9a64-066a73f1eead None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:02.148363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd8dc6-11cd-4bdd-96b0-7b939a077914 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:02.168442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33525d42-747f-474c-97fa-8c02690ca30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:02.169228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525d42-747f-474c-97fa-8c02690ca30c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:02.169522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525d42-747f-474c-97fa-8c02690ca30c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:02.169793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525d42-747f-474c-97fa-8c02690ca30c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:02.176712 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33525d42-747f-474c-97fa-8c02690ca30c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:02.178164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33525d42-747f-474c-97fa-8c02690ca30c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:02.180321 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3be5e-93ea-4975-8a61-226a2319e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:02.181106 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3be5e-93ea-4975-8a61-226a2319e09b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:02.181385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3be5e-93ea-4975-8a61-226a2319e09b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:02.181658 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3be5e-93ea-4975-8a61-226a2319e09b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:02.191291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3be5e-93ea-4975-8a61-226a2319e09b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-33525d42-747f-474c-97fa-8c02690ca30c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:09:02.191445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:02.192509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:02.193434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:09:02.193434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:09:02.193434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:09:02.193434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:09:02.193434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:09:02.193434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:09:02.193434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:09:02.193434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:02.193434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 537/1077] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:02.198240 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33525d42-747f-474c-97fa-8c02690ca30c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-aed3be5e-93ea-4975-8a61-226a2319e09b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:09:02.198953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:02.200370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:09:02.201509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 541/1078] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:09:02.206151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3be5e-93ea-4975-8a61-226a2319e09b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:02.295365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33525d42-747f-474c-97fa-8c02690ca30c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:02.300668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3be5e-93ea-4975-8a61-226a2319e09b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:02.327368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f4239-b8d9-4624-9b3a-ace0aab0558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:02.328017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4239-b8d9-4624-9b3a-ace0aab0558b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:02.328295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4239-b8d9-4624-9b3a-ace0aab0558b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:02.328567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4239-b8d9-4624-9b3a-ace0aab0558b None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:02.329340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f4239-b8d9-4624-9b3a-ace0aab0558b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:02.329643 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f4239-b8d9-4624-9b3a-ace0aab0558b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:02.331083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f4239-b8d9-4624-9b3a-ace0aab0558b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:02.331977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf7b7e-f39e-423b-8255-047374ed0729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:02.332639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf7b7e-f39e-423b-8255-047374ed0729 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:02.332923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf7b7e-f39e-423b-8255-047374ed0729 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:02.333201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf7b7e-f39e-423b-8255-047374ed0729 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:02.333951 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf7b7e-f39e-423b-8255-047374ed0729 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:02.334264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf7b7e-f39e-423b-8255-047374ed0729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:02.335682 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf7b7e-f39e-423b-8255-047374ed0729 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:02.342619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 538/1079] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:02.343601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 542/1080] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:09:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:02.348887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f4239-b8d9-4624-9b3a-ace0aab0558b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:02.349686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf7b7e-f39e-423b-8255-047374ed0729 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:02.441520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f4239-b8d9-4624-9b3a-ace0aab0558b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:02.441750 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf7b7e-f39e-423b-8255-047374ed0729 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:02.473520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b7b02-1414-4b7d-b88e-c2568581d302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:02.473770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ff25a-2e09-4ca4-88a6-7d496bf1d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:02.474386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b7b02-1414-4b7d-b88e-c2568581d302 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:02.474644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff25a-2e09-4ca4-88a6-7d496bf1d4f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:02.474747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b7b02-1414-4b7d-b88e-c2568581d302 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:02.474927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff25a-2e09-4ca4-88a6-7d496bf1d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:02.475028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b7b02-1414-4b7d-b88e-c2568581d302 None admin] PATH_INFO: `/v3/users/7d8e24771a0b47808ec876de48851a59` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:02.475237 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff25a-2e09-4ca4-88a6-7d496bf1d4f6 None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/efbbecde248c44c7b1d5f3c9522a48a2/roles/b1d2c3a8bfec44aeacafbdc51013fad7` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:02.476145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b7b02-1414-4b7d-b88e-c2568581d302 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8e24771a0b47808ec876de48851a59)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:02.477491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ff25a-2e09-4ca4-88a6-7d496bf1d4f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=efbbecde248c44c7b1d5f3c9522a48a2, role_id=b1d2c3a8bfec44aeacafbdc51013fad7)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:02.477596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b7b02-1414-4b7d-b88e-c2568581d302 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:02.478927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ff25a-2e09-4ca4-88a6-7d496bf1d4f6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:02.483163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 543/1081] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:02 2022] GET /identity/v3/users/7d8e24771a0b47808ec876de48851a59 => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:02.484769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b7b02-1414-4b7d-b88e-c2568581d302 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:02.581559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b7b02-1414-4b7d-b88e-c2568581d302 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:02.613212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4128d-09c4-4e8e-90a6-6d4e96640b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:02.614050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4128d-09c4-4e8e-90a6-6d4e96640b42 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:02.614330 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4128d-09c4-4e8e-90a6-6d4e96640b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:02.614602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4128d-09c4-4e8e-90a6-6d4e96640b42 None admin] PATH_INFO: `/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:02.615753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4128d-09c4-4e8e-90a6-6d4e96640b42 None admin] RBAC: Authorizing `identity:get_project(project_id=bd0bb3c91c2941f0a014bba6dd4e345b)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:02.617195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4128d-09c4-4e8e-90a6-6d4e96640b42 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:02.618860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 544/1082] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:09:02 2022] GET /identity/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:02.624688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4128d-09c4-4e8e-90a6-6d4e96640b42 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:02.645248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 539/1083] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:09:02 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/efbbecde248c44c7b1d5f3c9522a48a2/roles/b1d2c3a8bfec44aeacafbdc51013fad7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:09:02.724852 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4128d-09c4-4e8e-90a6-6d4e96640b42 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:02.759062 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2926847-62a1-4a76-a9bf-3f2a1e99fceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:02.759996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926847-62a1-4a76-a9bf-3f2a1e99fceb None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:02.760276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926847-62a1-4a76-a9bf-3f2a1e99fceb None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:02.760548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926847-62a1-4a76-a9bf-3f2a1e99fceb None admin] PATH_INFO: `/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b/users/7d8e24771a0b47808ec876de48851a59/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:02.762537 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2926847-62a1-4a76-a9bf-3f2a1e99fceb None admin] RBAC: Authorizing `identity:create_grant(project_id=bd0bb3c91c2941f0a014bba6dd4e345b, user_id=7d8e24771a0b47808ec876de48851a59, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:02.764026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2926847-62a1-4a76-a9bf-3f2a1e99fceb None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:02.834201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 545/1084] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:09:02 2022] PUT /identity/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b/users/7d8e24771a0b47808ec876de48851a59/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:09:04.850582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e6c5-a401-4f04-b954-400e98c3c729 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:04.851175 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e6c5-a401-4f04-b954-400e98c3c729 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:04.851175 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e6c5-a401-4f04-b954-400e98c3c729 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:04.852521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 540/1085] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:04.857852 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe665d-6c90-4ece-ac5d-d5d7913969ad None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:04.858273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe665d-6c90-4ece-ac5d-d5d7913969ad None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:04.858392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe665d-6c90-4ece-ac5d-d5d7913969ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:04.875219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d8fe665d-6c90-4ece-ac5d-d5d7913969ad None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:04.876979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d8fe665d-6c90-4ece-ac5d-d5d7913969ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:04.939891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 546/1086] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:04.963084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e6c5-a401-4f04-b954-400e98c3c729 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.000611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79371e1-1add-4faf-b0c3-4e96189bb0c2 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.001418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79371e1-1add-4faf-b0c3-4e96189bb0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.001700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79371e1-1add-4faf-b0c3-4e96189bb0c2 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.003087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 547/1087] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:09:05.008204 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb7f12-34a1-4fe4-8f88-1a5576c8a32b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.008497 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb7f12-34a1-4fe4-8f88-1a5576c8a32b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.008782 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb7f12-34a1-4fe4-8f88-1a5576c8a32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.024751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-1afb7f12-34a1-4fe4-8f88-1a5576c8a32b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:05.025935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-1afb7f12-34a1-4fe4-8f88-1a5576c8a32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:05.065341 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e6c5-a401-4f04-b954-400e98c3c729 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:05.089391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 548/1088] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:09:05.098264 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c4428-a9dc-4b8a-8e5a-342179357fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:05.099066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c4428-a9dc-4b8a-8e5a-342179357fba None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.099377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c4428-a9dc-4b8a-8e5a-342179357fba None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.099651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c4428-a9dc-4b8a-8e5a-342179357fba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.109360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c4428-a9dc-4b8a-8e5a-342179357fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:09:05.113014 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb7f12-34a1-4fe4-8f88-1a5576c8a32b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-8c5c4428-a9dc-4b8a-8e5a-342179357fba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:09:05.117994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:05.119245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:05.120165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 541/1089] 10.222.0.64 () {56 vars in 1120 bytes} [Fri May 13 17:09:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:05.124804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c4428-a9dc-4b8a-8e5a-342179357fba None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.220419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb7f12-34a1-4fe4-8f88-1a5576c8a32b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:05.221394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c4428-a9dc-4b8a-8e5a-342179357fba None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:05.253513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce02fe4-ce92-4870-9436-96232a5f36fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:05.253718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a781231-6b56-4bb7-bf89-c24d83cf8fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:05.254172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781231-6b56-4bb7-bf89-c24d83cf8fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.254279 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce02fe4-ce92-4870-9436-96232a5f36fd None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.254453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781231-6b56-4bb7-bf89-c24d83cf8fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.254549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce02fe4-ce92-4870-9436-96232a5f36fd None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.254724 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781231-6b56-4bb7-bf89-c24d83cf8fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.254825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce02fe4-ce92-4870-9436-96232a5f36fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.255500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a781231-6b56-4bb7-bf89-c24d83cf8fa4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:05.255802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a781231-6b56-4bb7-bf89-c24d83cf8fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:05.257193 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a781231-6b56-4bb7-bf89-c24d83cf8fa4 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:05.264502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce02fe4-ce92-4870-9436-96232a5f36fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:09:05.264820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 542/1090] 10.222.0.64 () {56 vars in 1115 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:05.270329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a781231-6b56-4bb7-bf89-c24d83cf8fa4 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-1ce02fe4-ce92-4870-9436-96232a5f36fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:09:05.272345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:05.273285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:05.274146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:09:05.278427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 549/1091] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:09:05.279323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce02fe4-ce92-4870-9436-96232a5f36fd None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.366206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a781231-6b56-4bb7-bf89-c24d83cf8fa4 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:05.372131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce02fe4-ce92-4870-9436-96232a5f36fd None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:05.397252 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d901c-1d5b-4dbc-a5bb-3a627bea7042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:05.398034 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d901c-1d5b-4dbc-a5bb-3a627bea7042 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.398315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d901c-1d5b-4dbc-a5bb-3a627bea7042 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.398586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d901c-1d5b-4dbc-a5bb-3a627bea7042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.402819 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3be58-a1fc-4465-9826-a4783fc6ed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:05.403494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3be58-a1fc-4465-9826-a4783fc6ed21 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.403775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3be58-a1fc-4465-9826-a4783fc6ed21 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.404047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3be58-a1fc-4465-9826-a4783fc6ed21 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.404780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3be58-a1fc-4465-9826-a4783fc6ed21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:05.405082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3be58-a1fc-4465-9826-a4783fc6ed21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:05.406469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3be58-a1fc-4465-9826-a4783fc6ed21 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:05.409307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d901c-1d5b-4dbc-a5bb-3a627bea7042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:05.410754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d901c-1d5b-4dbc-a5bb-3a627bea7042 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:05.414655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 550/1092] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:05.420415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3be58-a1fc-4465-9826-a4783fc6ed21 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-329d901c-1d5b-4dbc-a5bb-3a627bea7042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:09:05.427734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:05.428834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:05.429780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:09:05.429780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:09:05.429780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:09:05.429780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:05.429780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 543/1093] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:09:05.434346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d901c-1d5b-4dbc-a5bb-3a627bea7042 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.513890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3be58-a1fc-4465-9826-a4783fc6ed21 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:05.527601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d901c-1d5b-4dbc-a5bb-3a627bea7042 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:05.545687 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d12965-4486-4928-90ba-3841b6e19949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:05.546543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d12965-4486-4928-90ba-3841b6e19949 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.546831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d12965-4486-4928-90ba-3841b6e19949 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.547106 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d12965-4486-4928-90ba-3841b6e19949 None admin] PATH_INFO: `/v3/users/7d8e24771a0b47808ec876de48851a59` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.548343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d12965-4486-4928-90ba-3841b6e19949 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8e24771a0b47808ec876de48851a59)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:05.549775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d12965-4486-4928-90ba-3841b6e19949 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:05.551415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 551/1094] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/users/7d8e24771a0b47808ec876de48851a59 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:05.556996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d12965-4486-4928-90ba-3841b6e19949 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.559968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc4505-2059-42e8-9574-51a32454324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:05.560623 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4505-2059-42e8-9574-51a32454324f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.560907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4505-2059-42e8-9574-51a32454324f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.561180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4505-2059-42e8-9574-51a32454324f None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.561891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc4505-2059-42e8-9574-51a32454324f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:05.562196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc4505-2059-42e8-9574-51a32454324f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:05.563631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc4505-2059-42e8-9574-51a32454324f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:05.575302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 544/1095] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:05.581173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc4505-2059-42e8-9574-51a32454324f None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.650952 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d12965-4486-4928-90ba-3841b6e19949 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:05.678606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc4505-2059-42e8-9574-51a32454324f None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:05.682888 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b9ed5-4732-4e39-b730-ad5dfdf377f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:05.683556 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9ed5-4732-4e39-b730-ad5dfdf377f7 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.683838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9ed5-4732-4e39-b730-ad5dfdf377f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.684110 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9ed5-4732-4e39-b730-ad5dfdf377f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.711194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf9820-e2cd-4553-be48-43f4b2a66ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:05.711979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf9820-e2cd-4553-be48-43f4b2a66ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.712259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf9820-e2cd-4553-be48-43f4b2a66ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.712530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf9820-e2cd-4553-be48-43f4b2a66ee1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.719397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf9820-e2cd-4553-be48-43f4b2a66ee1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:05.723510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf9820-e2cd-4553-be48-43f4b2a66ee1 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-cbdf9820-e2cd-4553-be48-43f4b2a66ee1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:09:05.742338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:05.743727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:05.744903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:05.744903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:05.744903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:09:05.744903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:09:05.744903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:09:05.744903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:09:05.744903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:09:05.744903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:09:05.744903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 17:09:05.744903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:05.744903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 545/1096] 10.222.0.64 () {56 vars in 1093 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:09:05.749234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf9820-e2cd-4553-be48-43f4b2a66ee1 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.755425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b9ed5-4732-4e39-b730-ad5dfdf377f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:05.756888 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b9ed5-4732-4e39-b730-ad5dfdf377f7 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:05.842522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf9820-e2cd-4553-be48-43f4b2a66ee1 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:05.848983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 552/1097] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 17:09:05.854789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b9ed5-4732-4e39-b730-ad5dfdf377f7 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.875494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65e554-449c-4faa-bc24-0e3ae312db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:05.876667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65e554-449c-4faa-bc24-0e3ae312db15 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.876958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65e554-449c-4faa-bc24-0e3ae312db15 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.877227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65e554-449c-4faa-bc24-0e3ae312db15 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.878054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65e554-449c-4faa-bc24-0e3ae312db15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:05.878360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65e554-449c-4faa-bc24-0e3ae312db15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:05.879822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65e554-449c-4faa-bc24-0e3ae312db15 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:05.896088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 546/1098] 10.222.0.64 () {56 vars in 1133 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:05.901676 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65e554-449c-4faa-bc24-0e3ae312db15 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.946871 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b9ed5-4732-4e39-b730-ad5dfdf377f7 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:05.979144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41224a4b-4702-4114-a6a8-4315150d744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:05.980015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41224a4b-4702-4114-a6a8-4315150d744b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:05.980294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41224a4b-4702-4114-a6a8-4315150d744b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:05.980565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41224a4b-4702-4114-a6a8-4315150d744b None admin] PATH_INFO: `/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:05.981741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41224a4b-4702-4114-a6a8-4315150d744b None admin] RBAC: Authorizing `identity:get_project(project_id=bd0bb3c91c2941f0a014bba6dd4e345b)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:05.983201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41224a4b-4702-4114-a6a8-4315150d744b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:05.985489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 553/1099] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:05.991472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41224a4b-4702-4114-a6a8-4315150d744b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:05.996801 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65e554-449c-4faa-bc24-0e3ae312db15 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:06.029861 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ef4e0-b55b-49e0-8f6a-1efa45f0264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:06.030573 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef4e0-b55b-49e0-8f6a-1efa45f0264a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:06.030848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef4e0-b55b-49e0-8f6a-1efa45f0264a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:06.031116 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef4e0-b55b-49e0-8f6a-1efa45f0264a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:06.097401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41224a4b-4702-4114-a6a8-4315150d744b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:06.098637 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ef4e0-b55b-49e0-8f6a-1efa45f0264a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:06.100213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ef4e0-b55b-49e0-8f6a-1efa45f0264a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:06.130050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d12a5-b9de-47ce-83bb-5a49e471a31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:06.130703 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d12a5-b9de-47ce-83bb-5a49e471a31f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:06.130983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d12a5-b9de-47ce-83bb-5a49e471a31f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:06.131287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d12a5-b9de-47ce-83bb-5a49e471a31f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:06.132118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d12a5-b9de-47ce-83bb-5a49e471a31f None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=bd0bb3c91c2941f0a014bba6dd4e345b, user.id=7d8e24771a0b47808ec876de48851a59) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:06.132429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d12a5-b9de-47ce-83bb-5a49e471a31f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:06.133882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d12a5-b9de-47ce-83bb-5a49e471a31f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:06.139733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 554/1100] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/role_assignments?user.id=7d8e24771a0b47808ec876de48851a59&scope.project.id=bd0bb3c91c2941f0a014bba6dd4e345b&role.id=2791519d9bad43318f086666b6e64a20 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:06.199188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 547/1101] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:09:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 17:09:06.205304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d12a5-b9de-47ce-83bb-5a49e471a31f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:06.305724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d12a5-b9de-47ce-83bb-5a49e471a31f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:06.340024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27a840-1f1b-4e00-8de6-f47b3064024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:06.340832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a840-1f1b-4e00-8de6-f47b3064024c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:06.341123 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a840-1f1b-4e00-8de6-f47b3064024c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:06.341403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a840-1f1b-4e00-8de6-f47b3064024c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:06.352534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27a840-1f1b-4e00-8de6-f47b3064024c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:06.353988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27a840-1f1b-4e00-8de6-f47b3064024c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-2e27a840-1f1b-4e00-8de6-f47b3064024c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:09:06.370548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:06.371696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:06.372854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:09:06.372854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:09:06.372854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:09:06.372854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:09:06.372854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 555/1102] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:06.377588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ef4e0-b55b-49e0-8f6a-1efa45f0264a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:06.472055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ef4e0-b55b-49e0-8f6a-1efa45f0264a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:06.504541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c8f0c-e1a6-4c15-9257-bcb3699f8940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:06.505196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8f0c-e1a6-4c15-9257-bcb3699f8940 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:06.505478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8f0c-e1a6-4c15-9257-bcb3699f8940 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:06.505749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8f0c-e1a6-4c15-9257-bcb3699f8940 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:06.506458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c8f0c-e1a6-4c15-9257-bcb3699f8940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:06.506763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c8f0c-e1a6-4c15-9257-bcb3699f8940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:06.508177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c8f0c-e1a6-4c15-9257-bcb3699f8940 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:06.519006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 548/1103] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:06.524674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27a840-1f1b-4e00-8de6-f47b3064024c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:06.619947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27a840-1f1b-4e00-8de6-f47b3064024c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:06.651511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa7c8e-af53-4e04-85c2-aa157b454f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:06.652295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa7c8e-af53-4e04-85c2-aa157b454f77 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:06.652574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa7c8e-af53-4e04-85c2-aa157b454f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:06.652844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa7c8e-af53-4e04-85c2-aa157b454f77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:06.659750 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa7c8e-af53-4e04-85c2-aa157b454f77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:06.661190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa7c8e-af53-4e04-85c2-aa157b454f77 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-44aa7c8e-af53-4e04-85c2-aa157b454f77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:09:06.675597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:06.676691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:06.677812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:09:06.677812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:09:06.677812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:09:06.677812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:09:06.677812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:09:06.677812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:09:06.677812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:09:06.677812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:09:06.679413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 556/1104] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:06.682513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c8f0c-e1a6-4c15-9257-bcb3699f8940 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:06.778651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c8f0c-e1a6-4c15-9257-bcb3699f8940 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:06.810611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc758fc-cd79-4fe7-9b68-855f4235c1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:06.811300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc758fc-cd79-4fe7-9b68-855f4235c1ca None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:06.811581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc758fc-cd79-4fe7-9b68-855f4235c1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:06.811851 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc758fc-cd79-4fe7-9b68-855f4235c1ca None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:06.812621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc758fc-cd79-4fe7-9b68-855f4235c1ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:06.812974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc758fc-cd79-4fe7-9b68-855f4235c1ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:06.814387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc758fc-cd79-4fe7-9b68-855f4235c1ca None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:06.826079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 549/1105] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:06.832040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa7c8e-af53-4e04-85c2-aa157b454f77 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:06.926763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa7c8e-af53-4e04-85c2-aa157b454f77 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:06.960564 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90f305-9a90-4899-97fc-9c45b79f6c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:06.961221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f305-9a90-4899-97fc-9c45b79f6c53 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:06.961505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f305-9a90-4899-97fc-9c45b79f6c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:06.961781 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f305-9a90-4899-97fc-9c45b79f6c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:06.962615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90f305-9a90-4899-97fc-9c45b79f6c53 None admin] RBAC: Adding query filter params (role.id=b1d2c3a8bfec44aeacafbdc51013fad7, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=efbbecde248c44c7b1d5f3c9522a48a2) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:06.962926 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90f305-9a90-4899-97fc-9c45b79f6c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:06.964405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90f305-9a90-4899-97fc-9c45b79f6c53 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:06.970764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 557/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:09:06 2022] GET /identity/v3/role_assignments?user.id=efbbecde248c44c7b1d5f3c9522a48a2&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=b1d2c3a8bfec44aeacafbdc51013fad7 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:08.403457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e09fa-027e-408d-9867-fb2e89a1e7d1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:08.403999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e09fa-027e-408d-9867-fb2e89a1e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:08.403999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e09fa-027e-408d-9867-fb2e89a1e7d1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:08.405398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 550/1107] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:08.410995 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c383-2ac4-4ca9-b90c-d843fe227da7 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:08.411434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c383-2ac4-4ca9-b90c-d843fe227da7 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:08.411570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c383-2ac4-4ca9-b90c-d843fe227da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:08.428212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c459c383-2ac4-4ca9-b90c-d843fe227da7 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:08.429370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c459c383-2ac4-4ca9-b90c-d843fe227da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:08.490886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 558/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:08.514055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e09fa-027e-408d-9867-fb2e89a1e7d1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:08.609174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e09fa-027e-408d-9867-fb2e89a1e7d1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:08.640272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62904f7-7814-4d14-a923-f32457d30126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:08.641565 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62904f7-7814-4d14-a923-f32457d30126 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:08.641846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62904f7-7814-4d14-a923-f32457d30126 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:08.642114 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62904f7-7814-4d14-a923-f32457d30126 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:08.643297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62904f7-7814-4d14-a923-f32457d30126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:08.644733 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62904f7-7814-4d14-a923-f32457d30126 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:08.646294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 551/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:09:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:08.651884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459c383-2ac4-4ca9-b90c-d843fe227da7 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:08.745536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459c383-2ac4-4ca9-b90c-d843fe227da7 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:08.776833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec75d2f-7acc-4f67-9a0e-cb6a9cc76309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:08.777483 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec75d2f-7acc-4f67-9a0e-cb6a9cc76309 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:08.777766 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec75d2f-7acc-4f67-9a0e-cb6a9cc76309 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:08.778036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec75d2f-7acc-4f67-9a0e-cb6a9cc76309 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:08.778737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec75d2f-7acc-4f67-9a0e-cb6a9cc76309 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:08.780220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec75d2f-7acc-4f67-9a0e-cb6a9cc76309 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:08.867399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 559/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:09:08 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:09:11.089156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c0dc1-42cf-4334-a7c0-5e594f0edf94 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:11.089675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c0dc1-42cf-4334-a7c0-5e594f0edf94 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:11.089675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c0dc1-42cf-4334-a7c0-5e594f0edf94 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:11.091057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 552/1111] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:11.096373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edfc8b-e8a5-41d7-a013-3679176c5fe8 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:11.096744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edfc8b-e8a5-41d7-a013-3679176c5fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:11.096939 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edfc8b-e8a5-41d7-a013-3679176c5fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:11.113593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-94edfc8b-e8a5-41d7-a013-3679176c5fe8 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:11.114780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-94edfc8b-e8a5-41d7-a013-3679176c5fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:11.177895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 560/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:11.200609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c0dc1-42cf-4334-a7c0-5e594f0edf94 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:11.294494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c0dc1-42cf-4334-a7c0-5e594f0edf94 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:11.326410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cae002-2a39-4353-bd7e-33ef2504a314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:11.327267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cae002-2a39-4353-bd7e-33ef2504a314 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:11.327549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cae002-2a39-4353-bd7e-33ef2504a314 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:11.327819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cae002-2a39-4353-bd7e-33ef2504a314 None admin] PATH_INFO: `/v3/roles/1efabb1110d64eebacd85d9016d7d286` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:11.329282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cae002-2a39-4353-bd7e-33ef2504a314 None admin] RBAC: Authorizing `identity:get_role(role_id=1efabb1110d64eebacd85d9016d7d286)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:11.330662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cae002-2a39-4353-bd7e-33ef2504a314 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:11.332016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 553/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:11 2022] GET /identity/v3/roles/1efabb1110d64eebacd85d9016d7d286 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:11.337491 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edfc8b-e8a5-41d7-a013-3679176c5fe8 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:11.436983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edfc8b-e8a5-41d7-a013-3679176c5fe8 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:11.468553 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19494417-3ab2-4612-991b-61d5e2e699f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:11.469945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494417-3ab2-4612-991b-61d5e2e699f3 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:11.470227 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494417-3ab2-4612-991b-61d5e2e699f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:11.470501 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494417-3ab2-4612-991b-61d5e2e699f3 None admin] PATH_INFO: `/v3/users/a929431832de42578276753687469827` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:11.482803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19494417-3ab2-4612-991b-61d5e2e699f3 None admin] RBAC: Authorizing `identity:get_user(user_id=a929431832de42578276753687469827)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:11.484295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19494417-3ab2-4612-991b-61d5e2e699f3 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:11.486497 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 561/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:11 2022] GET /identity/v3/users/a929431832de42578276753687469827 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:11.492261 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cae002-2a39-4353-bd7e-33ef2504a314 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:11.586140 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cae002-2a39-4353-bd7e-33ef2504a314 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:11.617716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63494f-abae-4bfd-8985-41aee6292c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:11.618342 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63494f-abae-4bfd-8985-41aee6292c11 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:11.618621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63494f-abae-4bfd-8985-41aee6292c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:11.618894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63494f-abae-4bfd-8985-41aee6292c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:11.684039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63494f-abae-4bfd-8985-41aee6292c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:11.685514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63494f-abae-4bfd-8985-41aee6292c11 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:11.778408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 554/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:09:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:09:11.784338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19494417-3ab2-4612-991b-61d5e2e699f3 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:11.888407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19494417-3ab2-4612-991b-61d5e2e699f3 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:11.920125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5abc3e-d229-4e0e-a738-646c4736c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:11.920968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5abc3e-d229-4e0e-a738-646c4736c8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:11.921251 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5abc3e-d229-4e0e-a738-646c4736c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:11.921526 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5abc3e-d229-4e0e-a738-646c4736c8b6 None admin] PATH_INFO: `/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:11.922880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5abc3e-d229-4e0e-a738-646c4736c8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=bd0bb3c91c2941f0a014bba6dd4e345b)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:11.924360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5abc3e-d229-4e0e-a738-646c4736c8b6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:11.926039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 562/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:09:11 2022] GET /identity/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:11.932056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63494f-abae-4bfd-8985-41aee6292c11 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:12.026802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63494f-abae-4bfd-8985-41aee6292c11 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:12.066022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc8792-0961-4c94-a534-7a76a830993b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:12.066668 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc8792-0961-4c94-a534-7a76a830993b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:12.066953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc8792-0961-4c94-a534-7a76a830993b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:12.067263 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc8792-0961-4c94-a534-7a76a830993b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:12.068087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc8792-0961-4c94-a534-7a76a830993b None admin] RBAC: Adding query filter params (role.id=1efabb1110d64eebacd85d9016d7d286, scope.project.id=bd0bb3c91c2941f0a014bba6dd4e345b, user.id=a929431832de42578276753687469827) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:12.068399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc8792-0961-4c94-a534-7a76a830993b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:12.069991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc8792-0961-4c94-a534-7a76a830993b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:12.075936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 555/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:09:11 2022] GET /identity/v3/role_assignments?user.id=a929431832de42578276753687469827&scope.project.id=bd0bb3c91c2941f0a014bba6dd4e345b&role.id=1efabb1110d64eebacd85d9016d7d286 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:14.277179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219f36-fc04-4060-b810-2f7933a5c81d None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:14.277675 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219f36-fc04-4060-b810-2f7933a5c81d None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:14.277675 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219f36-fc04-4060-b810-2f7933a5c81d None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:14.279023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 563/1118] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:14.284729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5605d63-954f-482d-9e60-d05a1fc7f631 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:14.285136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5605d63-954f-482d-9e60-d05a1fc7f631 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:14.285296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5605d63-954f-482d-9e60-d05a1fc7f631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:14.302151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e5605d63-954f-482d-9e60-d05a1fc7f631 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:14.303371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e5605d63-954f-482d-9e60-d05a1fc7f631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:14.365755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 556/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:14.388080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0219f36-fc04-4060-b810-2f7933a5c81d None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:14.484528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0219f36-fc04-4060-b810-2f7933a5c81d None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:14.516761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffb907-c6ba-4144-9a94-41673ad0ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:14.517600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffb907-c6ba-4144-9a94-41673ad0ef48 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:14.517884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffb907-c6ba-4144-9a94-41673ad0ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:14.518159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffb907-c6ba-4144-9a94-41673ad0ef48 None admin] PATH_INFO: `/v3/roles/1efabb1110d64eebacd85d9016d7d286` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:14.519633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffb907-c6ba-4144-9a94-41673ad0ef48 None admin] RBAC: Authorizing `identity:get_role(role_id=1efabb1110d64eebacd85d9016d7d286)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:14.521169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffb907-c6ba-4144-9a94-41673ad0ef48 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:14.522543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 564/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:14 2022] GET /identity/v3/roles/1efabb1110d64eebacd85d9016d7d286 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:14.528399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5605d63-954f-482d-9e60-d05a1fc7f631 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:14.619997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5605d63-954f-482d-9e60-d05a1fc7f631 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:14.651366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92532be6-2663-4b50-b0ad-9fb2eb6589ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:14.652212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92532be6-2663-4b50-b0ad-9fb2eb6589ab None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:14.652485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92532be6-2663-4b50-b0ad-9fb2eb6589ab None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:14.652747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92532be6-2663-4b50-b0ad-9fb2eb6589ab None admin] PATH_INFO: `/v3/users/a929431832de42578276753687469827` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:14.653897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92532be6-2663-4b50-b0ad-9fb2eb6589ab None admin] RBAC: Authorizing `identity:get_user(user_id=a929431832de42578276753687469827)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:14.655360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92532be6-2663-4b50-b0ad-9fb2eb6589ab None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:14.656968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 557/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:14 2022] GET /identity/v3/users/a929431832de42578276753687469827 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:14.662538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffb907-c6ba-4144-9a94-41673ad0ef48 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:14.756111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffb907-c6ba-4144-9a94-41673ad0ef48 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:14.788009 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea0737-eb49-4785-a6a6-d68c479d8452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:14.788781 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0737-eb49-4785-a6a6-d68c479d8452 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:14.789065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0737-eb49-4785-a6a6-d68c479d8452 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:14.789338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0737-eb49-4785-a6a6-d68c479d8452 None admin] PATH_INFO: `/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:14.790489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea0737-eb49-4785-a6a6-d68c479d8452 None admin] RBAC: Authorizing `identity:get_project(project_id=bd0bb3c91c2941f0a014bba6dd4e345b)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:14.791950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea0737-eb49-4785-a6a6-d68c479d8452 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:14.793601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 565/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:09:14 2022] GET /identity/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:14.799742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92532be6-2663-4b50-b0ad-9fb2eb6589ab None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:14.893428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92532be6-2663-4b50-b0ad-9fb2eb6589ab None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:14.925663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb85980-1301-41a5-a73e-6bcf7c221f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:14.926530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb85980-1301-41a5-a73e-6bcf7c221f94 None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:14.926812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb85980-1301-41a5-a73e-6bcf7c221f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:14.927088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb85980-1301-41a5-a73e-6bcf7c221f94 None admin] PATH_INFO: `/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b/users/a929431832de42578276753687469827/roles/1efabb1110d64eebacd85d9016d7d286` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:14.929293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb85980-1301-41a5-a73e-6bcf7c221f94 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd0bb3c91c2941f0a014bba6dd4e345b, user_id=a929431832de42578276753687469827, role_id=1efabb1110d64eebacd85d9016d7d286)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:14.930734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb85980-1301-41a5-a73e-6bcf7c221f94 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:15.028018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 558/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:09:14 2022] PUT /identity/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b/users/a929431832de42578276753687469827/roles/1efabb1110d64eebacd85d9016d7d286 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:09:17.196337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61559-fd30-45de-a256-38f59cfda486 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:17.196859 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61559-fd30-45de-a256-38f59cfda486 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:17.196949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61559-fd30-45de-a256-38f59cfda486 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:17.198267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 566/1124] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:17.203762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec589e8-e7b7-4e7c-976b-29c9674395b4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:17.204214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec589e8-e7b7-4e7c-976b-29c9674395b4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:17.204310 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec589e8-e7b7-4e7c-976b-29c9674395b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:17.220799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2ec589e8-e7b7-4e7c-976b-29c9674395b4 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:17.221955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2ec589e8-e7b7-4e7c-976b-29c9674395b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:17.283799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 559/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:17.306908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb61559-fd30-45de-a256-38f59cfda486 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:17.401683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb61559-fd30-45de-a256-38f59cfda486 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:17.434273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea7281-5b61-4f93-8107-3e527b3c0fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:17.435104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7281-5b61-4f93-8107-3e527b3c0fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:17.435417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7281-5b61-4f93-8107-3e527b3c0fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:17.435714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7281-5b61-4f93-8107-3e527b3c0fd6 None admin] PATH_INFO: `/v3/roles/1efabb1110d64eebacd85d9016d7d286` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:17.437167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea7281-5b61-4f93-8107-3e527b3c0fd6 None admin] RBAC: Authorizing `identity:get_role(role_id=1efabb1110d64eebacd85d9016d7d286)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:17.439040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea7281-5b61-4f93-8107-3e527b3c0fd6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:17.440423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 567/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:17 2022] GET /identity/v3/roles/1efabb1110d64eebacd85d9016d7d286 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:17.445907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec589e8-e7b7-4e7c-976b-29c9674395b4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:17.540589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec589e8-e7b7-4e7c-976b-29c9674395b4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:17.572956 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb6ac-aa69-4d0b-bdc9-577ed956729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:17.573825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb6ac-aa69-4d0b-bdc9-577ed956729d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:17.574110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb6ac-aa69-4d0b-bdc9-577ed956729d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:17.574387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb6ac-aa69-4d0b-bdc9-577ed956729d None admin] PATH_INFO: `/v3/users/a929431832de42578276753687469827` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:17.575902 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabb6ac-aa69-4d0b-bdc9-577ed956729d None admin] RBAC: Authorizing `identity:get_user(user_id=a929431832de42578276753687469827)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:17.577355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabb6ac-aa69-4d0b-bdc9-577ed956729d None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:17.578963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 560/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:17 2022] GET /identity/v3/users/a929431832de42578276753687469827 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:17.584970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea7281-5b61-4f93-8107-3e527b3c0fd6 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:17.677328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea7281-5b61-4f93-8107-3e527b3c0fd6 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:17.708886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f17bd-0f57-4734-ad51-5abf3cd74bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:17.709506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f17bd-0f57-4734-ad51-5abf3cd74bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:17.709786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f17bd-0f57-4734-ad51-5abf3cd74bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:17.710058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f17bd-0f57-4734-ad51-5abf3cd74bf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:17.771857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f17bd-0f57-4734-ad51-5abf3cd74bf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:17.773306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f17bd-0f57-4734-ad51-5abf3cd74bf8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:17.866856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 568/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:09:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:09:17.872812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb6ac-aa69-4d0b-bdc9-577ed956729d None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:17.966411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb6ac-aa69-4d0b-bdc9-577ed956729d None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:17.999912 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae632430-ce83-480f-8a28-93879f1e23a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:18.000759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632430-ce83-480f-8a28-93879f1e23a0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:18.001059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632430-ce83-480f-8a28-93879f1e23a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:18.001324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae632430-ce83-480f-8a28-93879f1e23a0 None admin] PATH_INFO: `/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:18.002464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae632430-ce83-480f-8a28-93879f1e23a0 None admin] RBAC: Authorizing `identity:get_project(project_id=bd0bb3c91c2941f0a014bba6dd4e345b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:18.003936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae632430-ce83-480f-8a28-93879f1e23a0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:18.005602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 561/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:09:17 2022] GET /identity/v3/projects/bd0bb3c91c2941f0a014bba6dd4e345b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:18.011609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f17bd-0f57-4734-ad51-5abf3cd74bf8 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:18.103849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f17bd-0f57-4734-ad51-5abf3cd74bf8 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:18.136043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89411-f765-4899-a3df-e9478642d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:18.136622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89411-f765-4899-a3df-e9478642d2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:18.136907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89411-f765-4899-a3df-e9478642d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:18.137186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89411-f765-4899-a3df-e9478642d2c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:18.138012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a89411-f765-4899-a3df-e9478642d2c1 None admin] RBAC: Adding query filter params (role.id=1efabb1110d64eebacd85d9016d7d286, scope.project.id=bd0bb3c91c2941f0a014bba6dd4e345b, user.id=a929431832de42578276753687469827) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:18.138325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a89411-f765-4899-a3df-e9478642d2c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:18.139794 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a89411-f765-4899-a3df-e9478642d2c1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:18.145383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 569/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:09:18 2022] GET /identity/v3/role_assignments?user.id=a929431832de42578276753687469827&scope.project.id=bd0bb3c91c2941f0a014bba6dd4e345b&role.id=1efabb1110d64eebacd85d9016d7d286 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:20.356978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb583d-5f4a-46d9-b05b-2bf8ee8f607d None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:20.357473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb583d-5f4a-46d9-b05b-2bf8ee8f607d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:20.357473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb583d-5f4a-46d9-b05b-2bf8ee8f607d None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:20.358780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 562/1131] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:20.364646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6222c01-1056-4d57-a6dd-f7e10c70549f None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:20.365016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6222c01-1056-4d57-a6dd-f7e10c70549f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:20.365208 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6222c01-1056-4d57-a6dd-f7e10c70549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:20.381412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a6222c01-1056-4d57-a6dd-f7e10c70549f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:20.382606 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a6222c01-1056-4d57-a6dd-f7e10c70549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:20.445338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 570/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:20.468466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb583d-5f4a-46d9-b05b-2bf8ee8f607d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:20.564560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb583d-5f4a-46d9-b05b-2bf8ee8f607d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:20.597059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8985cd-b4e7-4045-ab7f-f7e5b1ff652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:20.597834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8985cd-b4e7-4045-ab7f-f7e5b1ff652a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:20.598117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8985cd-b4e7-4045-ab7f-f7e5b1ff652a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:20.598389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8985cd-b4e7-4045-ab7f-f7e5b1ff652a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:20.599572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8985cd-b4e7-4045-ab7f-f7e5b1ff652a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:20.601013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8985cd-b4e7-4045-ab7f-f7e5b1ff652a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:20.602602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 563/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:09:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:20.608337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6222c01-1056-4d57-a6dd-f7e10c70549f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:20.701288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6222c01-1056-4d57-a6dd-f7e10c70549f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:20.732197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121765d7-33c2-4921-801c-0c9c261c7a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:20.732867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121765d7-33c2-4921-801c-0c9c261c7a45 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:20.733151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121765d7-33c2-4921-801c-0c9c261c7a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:20.733427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121765d7-33c2-4921-801c-0c9c261c7a45 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:20.734134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121765d7-33c2-4921-801c-0c9c261c7a45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:20.736117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121765d7-33c2-4921-801c-0c9c261c7a45 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:20.822509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 571/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:09:20 2022] POST /identity/v3/projects => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:09:23.072401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef518431-06d1-461f-8ebc-c6197a8102f3 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:23.072862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef518431-06d1-461f-8ebc-c6197a8102f3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:23.072950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef518431-06d1-461f-8ebc-c6197a8102f3 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:23.074304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 564/1135] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:23.079881 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c6cc-c966-41cb-8d79-62742d020c13 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:23.080282 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c6cc-c966-41cb-8d79-62742d020c13 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:23.080447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c6cc-c966-41cb-8d79-62742d020c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:23.096741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-52b9c6cc-c966-41cb-8d79-62742d020c13 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:23.097941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-52b9c6cc-c966-41cb-8d79-62742d020c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:23.161349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 572/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:23.185851 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef518431-06d1-461f-8ebc-c6197a8102f3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:23.280789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef518431-06d1-461f-8ebc-c6197a8102f3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:23.313634 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785ad7-895b-4f0a-b135-5ae94bb60412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:23.314408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785ad7-895b-4f0a-b135-5ae94bb60412 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:23.314686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785ad7-895b-4f0a-b135-5ae94bb60412 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:23.314958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785ad7-895b-4f0a-b135-5ae94bb60412 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:23.316131 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785ad7-895b-4f0a-b135-5ae94bb60412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:23.317570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785ad7-895b-4f0a-b135-5ae94bb60412 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:23.319150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 565/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:09:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:23.324628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9c6cc-c966-41cb-8d79-62742d020c13 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:23.417233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9c6cc-c966-41cb-8d79-62742d020c13 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:23.448882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4498fd2-b2c4-4c22-a4f0-b74a38539301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:23.449539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4498fd2-b2c4-4c22-a4f0-b74a38539301 None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:23.449825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4498fd2-b2c4-4c22-a4f0-b74a38539301 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:23.450347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4498fd2-b2c4-4c22-a4f0-b74a38539301 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:23.451065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4498fd2-b2c4-4c22-a4f0-b74a38539301 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:23.452525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4498fd2-b2c4-4c22-a4f0-b74a38539301 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:23.530296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 573/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:09:23 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:09:25.749876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a168-b764-4e69-b732-93ebd48ab46c None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:25.750929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a168-b764-4e69-b732-93ebd48ab46c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:25.751022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a168-b764-4e69-b732-93ebd48ab46c None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:25.752332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 566/1139] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:25.757438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2647e5-e0c8-43c9-b310-1e96aa011f3b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:25.757894 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2647e5-e0c8-43c9-b310-1e96aa011f3b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:25.757990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2647e5-e0c8-43c9-b310-1e96aa011f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:25.774255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-aa2647e5-e0c8-43c9-b310-1e96aa011f3b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:25.775464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-aa2647e5-e0c8-43c9-b310-1e96aa011f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:25.839247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 574/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 17:09:25.862415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44a168-b764-4e69-b732-93ebd48ab46c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:25.958113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44a168-b764-4e69-b732-93ebd48ab46c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:25.998297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645c49-948d-402b-8744-074c76185275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:25.999092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645c49-948d-402b-8744-074c76185275 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:25.999404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645c49-948d-402b-8744-074c76185275 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:25.999678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645c49-948d-402b-8744-074c76185275 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:26.010256 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645c49-948d-402b-8744-074c76185275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-4a645c49-948d-402b-8744-074c76185275 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:09:26.017853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:26.018989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:26.020250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 567/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:26.024941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2647e5-e0c8-43c9-b310-1e96aa011f3b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:26.117203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2647e5-e0c8-43c9-b310-1e96aa011f3b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:26.148633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f456f9-6840-42e3-af9d-4ea51698a61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:26.149282 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f456f9-6840-42e3-af9d-4ea51698a61b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:26.149561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f456f9-6840-42e3-af9d-4ea51698a61b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:26.149833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f456f9-6840-42e3-af9d-4ea51698a61b None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:26.150567 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f456f9-6840-42e3-af9d-4ea51698a61b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:26.150871 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f456f9-6840-42e3-af9d-4ea51698a61b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:26.152268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f456f9-6840-42e3-af9d-4ea51698a61b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:26.160330 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 575/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:09:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:26.165899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645c49-948d-402b-8744-074c76185275 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:26.261552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645c49-948d-402b-8744-074c76185275 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:26.292894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c82bda-ae27-4fb4-b9a5-586b1b261455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:26.293743 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c82bda-ae27-4fb4-b9a5-586b1b261455 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:26.294022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c82bda-ae27-4fb4-b9a5-586b1b261455 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:26.294293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c82bda-ae27-4fb4-b9a5-586b1b261455 None admin] PATH_INFO: `/v3/users/26063b06aa1c4a97ae028f87b5ecd7a5` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:26.307241 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c82bda-ae27-4fb4-b9a5-586b1b261455 None admin] RBAC: Authorizing `identity:get_user(user_id=26063b06aa1c4a97ae028f87b5ecd7a5)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:26.308705 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c82bda-ae27-4fb4-b9a5-586b1b261455 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:26.310322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 568/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:26 2022] GET /identity/v3/users/26063b06aa1c4a97ae028f87b5ecd7a5 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:26.315846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f456f9-6840-42e3-af9d-4ea51698a61b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:26.407940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f456f9-6840-42e3-af9d-4ea51698a61b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:26.438856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86a6dc-8910-440f-8e9a-3de04e1a0371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:26.439505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a6dc-8910-440f-8e9a-3de04e1a0371 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:26.439786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a6dc-8910-440f-8e9a-3de04e1a0371 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:26.440058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a6dc-8910-440f-8e9a-3de04e1a0371 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:26.502348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86a6dc-8910-440f-8e9a-3de04e1a0371 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:26.503827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86a6dc-8910-440f-8e9a-3de04e1a0371 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:26.593597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 576/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:09:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:09:26.599870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c82bda-ae27-4fb4-b9a5-586b1b261455 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:26.693118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c82bda-ae27-4fb4-b9a5-586b1b261455 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:26.725575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737777c-4ddf-4914-8080-846d43046b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:26.726418 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737777c-4ddf-4914-8080-846d43046b8b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:26.726697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737777c-4ddf-4914-8080-846d43046b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:26.726968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737777c-4ddf-4914-8080-846d43046b8b None admin] PATH_INFO: `/v3/projects/9a90ec5c21fb487c81ecceadba57cb1c` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:26.728172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737777c-4ddf-4914-8080-846d43046b8b None admin] RBAC: Authorizing `identity:get_project(project_id=9a90ec5c21fb487c81ecceadba57cb1c)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:26.729620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737777c-4ddf-4914-8080-846d43046b8b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:26.731301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 569/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:09:26 2022] GET /identity/v3/projects/9a90ec5c21fb487c81ecceadba57cb1c => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:26.737325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86a6dc-8910-440f-8e9a-3de04e1a0371 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:26.830212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86a6dc-8910-440f-8e9a-3de04e1a0371 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:26.865673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1521d1-f881-44f1-a524-aa331dfedc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:26.866320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1521d1-f881-44f1-a524-aa331dfedc29 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:26.866601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1521d1-f881-44f1-a524-aa331dfedc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:26.866876 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1521d1-f881-44f1-a524-aa331dfedc29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:26.867735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1521d1-f881-44f1-a524-aa331dfedc29 None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=9a90ec5c21fb487c81ecceadba57cb1c, user.id=26063b06aa1c4a97ae028f87b5ecd7a5) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:26.868045 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1521d1-f881-44f1-a524-aa331dfedc29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:26.869479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1521d1-f881-44f1-a524-aa331dfedc29 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:26.874719 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 577/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:09:26 2022] GET /identity/v3/role_assignments?user.id=26063b06aa1c4a97ae028f87b5ecd7a5&scope.project.id=9a90ec5c21fb487c81ecceadba57cb1c&role.id=2791519d9bad43318f086666b6e64a20 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:29.051345 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ced58-7fc2-4f81-a730-3857e96cb030 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:29.051813 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ced58-7fc2-4f81-a730-3857e96cb030 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:29.051906 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ced58-7fc2-4f81-a730-3857e96cb030 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:29.053246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 570/1147] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:29.058343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ddd8c-d054-44dd-8c1f-49ebdcc724fc None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:29.058776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ddd8c-d054-44dd-8c1f-49ebdcc724fc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:29.058903 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ddd8c-d054-44dd-8c1f-49ebdcc724fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:29.076015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-204ddd8c-d054-44dd-8c1f-49ebdcc724fc None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:29.077203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-204ddd8c-d054-44dd-8c1f-49ebdcc724fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:29.138761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 578/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:29.162018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ced58-7fc2-4f81-a730-3857e96cb030 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:29.267079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ced58-7fc2-4f81-a730-3857e96cb030 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:29.299035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acd3f1-6cbe-4d10-9dcd-a661bffcecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:29.299843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acd3f1-6cbe-4d10-9dcd-a661bffcecb3 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:29.300124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acd3f1-6cbe-4d10-9dcd-a661bffcecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:29.300399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acd3f1-6cbe-4d10-9dcd-a661bffcecb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:29.309984 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acd3f1-6cbe-4d10-9dcd-a661bffcecb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-07acd3f1-6cbe-4d10-9dcd-a661bffcecb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:09:29.317560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:29.318744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:29.319820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 571/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:09:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:29.324752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ddd8c-d054-44dd-8c1f-49ebdcc724fc None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:29.417270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ddd8c-d054-44dd-8c1f-49ebdcc724fc None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:29.448854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121d2eb-d8b8-4359-a56c-07c2b3ae194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:29.449506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121d2eb-d8b8-4359-a56c-07c2b3ae194f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:29.449792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121d2eb-d8b8-4359-a56c-07c2b3ae194f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:29.450070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121d2eb-d8b8-4359-a56c-07c2b3ae194f None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:29.451073 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121d2eb-d8b8-4359-a56c-07c2b3ae194f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:29.451421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121d2eb-d8b8-4359-a56c-07c2b3ae194f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:29.452801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121d2eb-d8b8-4359-a56c-07c2b3ae194f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:29.460454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 579/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:09:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:29.465982 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acd3f1-6cbe-4d10-9dcd-a661bffcecb3 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:29.568430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acd3f1-6cbe-4d10-9dcd-a661bffcecb3 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:29.660677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d2217-32de-44a7-9a96-51cda348c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:29.660677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2217-32de-44a7-9a96-51cda348c84a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:29.660677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2217-32de-44a7-9a96-51cda348c84a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:29.660677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2217-32de-44a7-9a96-51cda348c84a None admin] PATH_INFO: `/v3/users/26063b06aa1c4a97ae028f87b5ecd7a5` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:29.661543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d2217-32de-44a7-9a96-51cda348c84a None admin] RBAC: Authorizing `identity:get_user(user_id=26063b06aa1c4a97ae028f87b5ecd7a5)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:29.661543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d2217-32de-44a7-9a96-51cda348c84a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:29.661543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 572/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:29 2022] GET /identity/v3/users/26063b06aa1c4a97ae028f87b5ecd7a5 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:29.661786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121d2eb-d8b8-4359-a56c-07c2b3ae194f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:29.710809 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121d2eb-d8b8-4359-a56c-07c2b3ae194f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:29.741770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d05467-f13f-4ecf-ae80-7bf5dd3ce8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:29.742616 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d05467-f13f-4ecf-ae80-7bf5dd3ce8be None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:29.742896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d05467-f13f-4ecf-ae80-7bf5dd3ce8be None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:29.743192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d05467-f13f-4ecf-ae80-7bf5dd3ce8be None admin] PATH_INFO: `/v3/projects/9a90ec5c21fb487c81ecceadba57cb1c` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:29.744363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d05467-f13f-4ecf-ae80-7bf5dd3ce8be None admin] RBAC: Authorizing `identity:get_project(project_id=9a90ec5c21fb487c81ecceadba57cb1c)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:29.745793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d05467-f13f-4ecf-ae80-7bf5dd3ce8be None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:29.747489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 580/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:09:29 2022] GET /identity/v3/projects/9a90ec5c21fb487c81ecceadba57cb1c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:29.753319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d2217-32de-44a7-9a96-51cda348c84a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:29.846659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d2217-32de-44a7-9a96-51cda348c84a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:29.882764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f4d72-89b4-48ce-93dd-c463cec37587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:29.883670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f4d72-89b4-48ce-93dd-c463cec37587 None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:29.883943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f4d72-89b4-48ce-93dd-c463cec37587 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:29.884208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f4d72-89b4-48ce-93dd-c463cec37587 None admin] PATH_INFO: `/v3/projects/9a90ec5c21fb487c81ecceadba57cb1c/users/26063b06aa1c4a97ae028f87b5ecd7a5/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:29.886112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f4d72-89b4-48ce-93dd-c463cec37587 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a90ec5c21fb487c81ecceadba57cb1c, user_id=26063b06aa1c4a97ae028f87b5ecd7a5, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:29.887586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f4d72-89b4-48ce-93dd-c463cec37587 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:29.957083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 573/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:09:29 2022] PUT /identity/v3/projects/9a90ec5c21fb487c81ecceadba57cb1c/users/26063b06aa1c4a97ae028f87b5ecd7a5/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:09:32.133075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e370725-1e41-4b9b-932f-86fadfa00c42 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:32.133618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e370725-1e41-4b9b-932f-86fadfa00c42 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:32.133618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e370725-1e41-4b9b-932f-86fadfa00c42 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:32.134977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 581/1154] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:32.140105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd65a0e-b289-420f-9508-b5e967567525 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:32.140476 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd65a0e-b289-420f-9508-b5e967567525 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:32.141210 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd65a0e-b289-420f-9508-b5e967567525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:32.157352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-efd65a0e-b289-420f-9508-b5e967567525 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:32.158529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-efd65a0e-b289-420f-9508-b5e967567525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:32.220604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 574/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:32.243435 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e370725-1e41-4b9b-932f-86fadfa00c42 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:32.342434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e370725-1e41-4b9b-932f-86fadfa00c42 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:32.374525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced8f3a-d8cb-4bb5-9557-f591027b1872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:32.375352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced8f3a-d8cb-4bb5-9557-f591027b1872 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:32.375641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced8f3a-d8cb-4bb5-9557-f591027b1872 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:32.375997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced8f3a-d8cb-4bb5-9557-f591027b1872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:32.385973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced8f3a-d8cb-4bb5-9557-f591027b1872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-7ced8f3a-d8cb-4bb5-9557-f591027b1872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:09:32.393664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:32.394797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:09:32.395861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 582/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:09:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:32.400792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd65a0e-b289-420f-9508-b5e967567525 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:32.493374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd65a0e-b289-420f-9508-b5e967567525 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:32.524968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa642-5cb2-49a6-ac23-da6957abdeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:32.525557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa642-5cb2-49a6-ac23-da6957abdeeb None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:32.525832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa642-5cb2-49a6-ac23-da6957abdeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:32.526102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa642-5cb2-49a6-ac23-da6957abdeeb None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:32.526825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aa642-5cb2-49a6-ac23-da6957abdeeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:32.527142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aa642-5cb2-49a6-ac23-da6957abdeeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:32.528529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aa642-5cb2-49a6-ac23-da6957abdeeb None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:32.536743 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 575/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:09:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:32.542278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced8f3a-d8cb-4bb5-9557-f591027b1872 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:32.634779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced8f3a-d8cb-4bb5-9557-f591027b1872 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:32.666899 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac32b32-6fd0-4ad7-86f7-57464eb017ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:32.667775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32b32-6fd0-4ad7-86f7-57464eb017ec None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:32.668061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32b32-6fd0-4ad7-86f7-57464eb017ec None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:32.668337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32b32-6fd0-4ad7-86f7-57464eb017ec None admin] PATH_INFO: `/v3/users/26063b06aa1c4a97ae028f87b5ecd7a5` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:32.669507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac32b32-6fd0-4ad7-86f7-57464eb017ec None admin] RBAC: Authorizing `identity:get_user(user_id=26063b06aa1c4a97ae028f87b5ecd7a5)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:32.670952 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac32b32-6fd0-4ad7-86f7-57464eb017ec None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:32.672607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 583/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:32 2022] GET /identity/v3/users/26063b06aa1c4a97ae028f87b5ecd7a5 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:32.678115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa642-5cb2-49a6-ac23-da6957abdeeb None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:32.770808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa642-5cb2-49a6-ac23-da6957abdeeb None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:32.802066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edc674-e3f2-4a81-89b8-73e9f73f04af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:32.802637 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edc674-e3f2-4a81-89b8-73e9f73f04af None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:32.802913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edc674-e3f2-4a81-89b8-73e9f73f04af None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:32.803207 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edc674-e3f2-4a81-89b8-73e9f73f04af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:32.866153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edc674-e3f2-4a81-89b8-73e9f73f04af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:32.867635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edc674-e3f2-4a81-89b8-73e9f73f04af None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:32.958722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 576/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:09:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:09:32.964611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac32b32-6fd0-4ad7-86f7-57464eb017ec None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:33.057679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac32b32-6fd0-4ad7-86f7-57464eb017ec None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:33.089079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2813660-d556-463b-831d-3620b7a34570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:33.089929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813660-d556-463b-831d-3620b7a34570 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:33.090213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813660-d556-463b-831d-3620b7a34570 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:33.090487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813660-d556-463b-831d-3620b7a34570 None admin] PATH_INFO: `/v3/projects/9a90ec5c21fb487c81ecceadba57cb1c` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:33.091679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2813660-d556-463b-831d-3620b7a34570 None admin] RBAC: Authorizing `identity:get_project(project_id=9a90ec5c21fb487c81ecceadba57cb1c)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:33.093125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2813660-d556-463b-831d-3620b7a34570 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:33.095353 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 584/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:09:32 2022] GET /identity/v3/projects/9a90ec5c21fb487c81ecceadba57cb1c => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:33.101276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edc674-e3f2-4a81-89b8-73e9f73f04af None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:33.193858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edc674-e3f2-4a81-89b8-73e9f73f04af None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:33.226803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80d3c8-61f0-44b6-a5d8-92cec559c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:33.227475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d3c8-61f0-44b6-a5d8-92cec559c20f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:33.227813 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d3c8-61f0-44b6-a5d8-92cec559c20f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:33.228093 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d3c8-61f0-44b6-a5d8-92cec559c20f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:33.228914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80d3c8-61f0-44b6-a5d8-92cec559c20f None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=9a90ec5c21fb487c81ecceadba57cb1c, user.id=26063b06aa1c4a97ae028f87b5ecd7a5) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:33.229226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80d3c8-61f0-44b6-a5d8-92cec559c20f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:33.230729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80d3c8-61f0-44b6-a5d8-92cec559c20f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:33.237195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 577/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:09:33 2022] GET /identity/v3/role_assignments?user.id=26063b06aa1c4a97ae028f87b5ecd7a5&scope.project.id=9a90ec5c21fb487c81ecceadba57cb1c&role.id=2791519d9bad43318f086666b6e64a20 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:35.469086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e6ffe-d04b-432e-b212-245334876151 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:35.469651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e6ffe-d04b-432e-b212-245334876151 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:35.469651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e6ffe-d04b-432e-b212-245334876151 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:35.471032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 585/1162] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:35.476200 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026a28-a855-4dd8-8624-2871f64df5cf None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:35.476590 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026a28-a855-4dd8-8624-2871f64df5cf None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:35.476756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026a28-a855-4dd8-8624-2871f64df5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:35.493603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e4026a28-a855-4dd8-8624-2871f64df5cf None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:35.494779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e4026a28-a855-4dd8-8624-2871f64df5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:35.556686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 578/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:35.579269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e6ffe-d04b-432e-b212-245334876151 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:35.674706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e6ffe-d04b-432e-b212-245334876151 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:35.706732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f11d27-68e9-4015-bdc6-f54e054298bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:35.707388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f11d27-68e9-4015-bdc6-f54e054298bc None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:35.707676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f11d27-68e9-4015-bdc6-f54e054298bc None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:35.707956 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f11d27-68e9-4015-bdc6-f54e054298bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:35.770618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f11d27-68e9-4015-bdc6-f54e054298bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:35.772042 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f11d27-68e9-4015-bdc6-f54e054298bc None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:35.863612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 586/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:09:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:09:35.869535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4026a28-a855-4dd8-8624-2871f64df5cf None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:35.962329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4026a28-a855-4dd8-8624-2871f64df5cf None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:35.995324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42021ca-2328-465f-83af-c0c27c0ebdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:35.996124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42021ca-2328-465f-83af-c0c27c0ebdc4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:35.996410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42021ca-2328-465f-83af-c0c27c0ebdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:35.996686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42021ca-2328-465f-83af-c0c27c0ebdc4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:36.003314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42021ca-2328-465f-83af-c0c27c0ebdc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:36.004784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42021ca-2328-465f-83af-c0c27c0ebdc4 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-b42021ca-2328-465f-83af-c0c27c0ebdc4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:36.018662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:36.028785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:36.029734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 579/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Fri May 13 17:09:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:36.030646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f11d27-68e9-4015-bdc6-f54e054298bc None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:36.127340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f11d27-68e9-4015-bdc6-f54e054298bc None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:36.159925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6011ae4-6769-458f-9e4f-afcb8dcf50a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:36.160571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6011ae4-6769-458f-9e4f-afcb8dcf50a9 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:36.160857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6011ae4-6769-458f-9e4f-afcb8dcf50a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:36.161134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6011ae4-6769-458f-9e4f-afcb8dcf50a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:36.161846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6011ae4-6769-458f-9e4f-afcb8dcf50a9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:36.162151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6011ae4-6769-458f-9e4f-afcb8dcf50a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:36.163562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6011ae4-6769-458f-9e4f-afcb8dcf50a9 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:36.170345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 587/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Fri May 13 17:09:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:38.363074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646069f-08c6-4422-afae-0a8091ae0cdf None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:38.363767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646069f-08c6-4422-afae-0a8091ae0cdf None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:38.363767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646069f-08c6-4422-afae-0a8091ae0cdf None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:38.365037 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 580/1167] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:38.370293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6168e4-6364-4f57-a01b-d2362e560c67 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:38.370686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6168e4-6364-4f57-a01b-d2362e560c67 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:38.370859 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6168e4-6364-4f57-a01b-d2362e560c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:38.387078 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-4b6168e4-6364-4f57-a01b-d2362e560c67 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:38.388292 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-4b6168e4-6364-4f57-a01b-d2362e560c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:38.451423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 588/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:38.474125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646069f-08c6-4422-afae-0a8091ae0cdf None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:38.571261 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646069f-08c6-4422-afae-0a8091ae0cdf None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:38.603270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da709ff1-c239-498f-80a7-6f7a83d1aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:38.603909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709ff1-c239-498f-80a7-6f7a83d1aa00 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:38.604189 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709ff1-c239-498f-80a7-6f7a83d1aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:38.604460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709ff1-c239-498f-80a7-6f7a83d1aa00 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:38.605195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da709ff1-c239-498f-80a7-6f7a83d1aa00 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:38.606573 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da709ff1-c239-498f-80a7-6f7a83d1aa00 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:38.680447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 581/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Fri May 13 17:09:38 2022] POST /identity/v3/domains => generated 267 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:09:40.876215 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b995e6-3ded-4d20-b785-4c795ba4ca21 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:40.876752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b995e6-3ded-4d20-b785-4c795ba4ca21 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:40.876752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b995e6-3ded-4d20-b785-4c795ba4ca21 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:40.878986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 589/1170] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:40.884736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898eba0-a8f3-415e-9581-d22d62b2abfa None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:40.885178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898eba0-a8f3-415e-9581-d22d62b2abfa None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:40.885280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898eba0-a8f3-415e-9581-d22d62b2abfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:40.901659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a898eba0-a8f3-415e-9581-d22d62b2abfa None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:40.902858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a898eba0-a8f3-415e-9581-d22d62b2abfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:40.966488 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 582/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:40.989833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b995e6-3ded-4d20-b785-4c795ba4ca21 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:41.084642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b995e6-3ded-4d20-b785-4c795ba4ca21 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:41.115856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846851e0-bc49-4a81-b3a0-05515e5b7cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:41.116690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846851e0-bc49-4a81-b3a0-05515e5b7cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:41.116968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846851e0-bc49-4a81-b3a0-05515e5b7cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:41.117236 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846851e0-bc49-4a81-b3a0-05515e5b7cc3 None admin] PATH_INFO: `/v3/domains/02bed8892a8a49418cdf3b36b0e1f995` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:41.127560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846851e0-bc49-4a81-b3a0-05515e5b7cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=02bed8892a8a49418cdf3b36b0e1f995)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:41.128943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846851e0-bc49-4a81-b3a0-05515e5b7cc3 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:41.130530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 590/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Fri May 13 17:09:40 2022] GET /identity/v3/domains/02bed8892a8a49418cdf3b36b0e1f995 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:41.136258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898eba0-a8f3-415e-9581-d22d62b2abfa None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:41.228022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898eba0-a8f3-415e-9581-d22d62b2abfa None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:41.264573 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6768254-d8c2-4a80-9e5e-f2f1bd1185b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:41.265220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768254-d8c2-4a80-9e5e-f2f1bd1185b4 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:41.265523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768254-d8c2-4a80-9e5e-f2f1bd1185b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:41.265791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768254-d8c2-4a80-9e5e-f2f1bd1185b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:41.266485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6768254-d8c2-4a80-9e5e-f2f1bd1185b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:41.267956 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6768254-d8c2-4a80-9e5e-f2f1bd1185b4 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:41.376603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 583/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:09:41 2022] POST /identity/v3/projects => generated 361 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:09:43.610862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ba160-21ea-4e21-a737-0ff022ee090c None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:43.611601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ba160-21ea-4e21-a737-0ff022ee090c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:43.611601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ba160-21ea-4e21-a737-0ff022ee090c None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:43.612810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 591/1174] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:43.618117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c383-3bbd-48ef-85d9-977bb81b6f2e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:43.618533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c383-3bbd-48ef-85d9-977bb81b6f2e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:43.618675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c383-3bbd-48ef-85d9-977bb81b6f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:43.635492 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5578c383-3bbd-48ef-85d9-977bb81b6f2e None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:43.636668 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5578c383-3bbd-48ef-85d9-977bb81b6f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:43.698922 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 584/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:43.723745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ba160-21ea-4e21-a737-0ff022ee090c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:43.819600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ba160-21ea-4e21-a737-0ff022ee090c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:43.851298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4808c9-4dfb-47de-bf0e-f4806f965746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:43.852142 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4808c9-4dfb-47de-bf0e-f4806f965746 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:43.852428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4808c9-4dfb-47de-bf0e-f4806f965746 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:43.852707 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4808c9-4dfb-47de-bf0e-f4806f965746 None admin] PATH_INFO: `/v3/domains/02bed8892a8a49418cdf3b36b0e1f995` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:43.853875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4808c9-4dfb-47de-bf0e-f4806f965746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=02bed8892a8a49418cdf3b36b0e1f995)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:43.855343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4808c9-4dfb-47de-bf0e-f4806f965746 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:43.856945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 592/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Fri May 13 17:09:43 2022] GET /identity/v3/domains/02bed8892a8a49418cdf3b36b0e1f995 => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:43.862924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578c383-3bbd-48ef-85d9-977bb81b6f2e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:43.955938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578c383-3bbd-48ef-85d9-977bb81b6f2e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:43.988438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6756ba8-eb2f-44b1-89fd-417f5e4d1d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:43.989102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756ba8-eb2f-44b1-89fd-417f5e4d1d9b None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:43.989387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756ba8-eb2f-44b1-89fd-417f5e4d1d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:43.989666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756ba8-eb2f-44b1-89fd-417f5e4d1d9b None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:43.990373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6756ba8-eb2f-44b1-89fd-417f5e4d1d9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:43.991869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6756ba8-eb2f-44b1-89fd-417f5e4d1d9b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:44.100650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 585/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:09:43 2022] POST /identity/v3/users => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:09:46.358847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108d1c8-542f-4972-87a3-0da3e2d4296b None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:46.360028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108d1c8-542f-4972-87a3-0da3e2d4296b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:46.360028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108d1c8-542f-4972-87a3-0da3e2d4296b None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:46.361228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 593/1178] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:46.366557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c09a-7b5b-45e0-9f9d-45f0a6fc2ce4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:46.366933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c09a-7b5b-45e0-9f9d-45f0a6fc2ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:46.367103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c09a-7b5b-45e0-9f9d-45f0a6fc2ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:46.384303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6fa4c09a-7b5b-45e0-9f9d-45f0a6fc2ce4 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:46.385470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6fa4c09a-7b5b-45e0-9f9d-45f0a6fc2ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:46.447698 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 586/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:46.470877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108d1c8-542f-4972-87a3-0da3e2d4296b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:46.565919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108d1c8-542f-4972-87a3-0da3e2d4296b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:46.597460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928323-ecf2-42e9-8a87-976ed37f14b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:46.598229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928323-ecf2-42e9-8a87-976ed37f14b4 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:46.598536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928323-ecf2-42e9-8a87-976ed37f14b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:46.598805 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928323-ecf2-42e9-8a87-976ed37f14b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:46.608300 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f928323-ecf2-42e9-8a87-976ed37f14b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-0f928323-ecf2-42e9-8a87-976ed37f14b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:09:46.616504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:46.617628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:09:46.618921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 594/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:09:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:46.623449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c09a-7b5b-45e0-9f9d-45f0a6fc2ce4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:46.715312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c09a-7b5b-45e0-9f9d-45f0a6fc2ce4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:46.747662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239f27-b8c8-4f86-b859-670eb41832d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:46.748311 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239f27-b8c8-4f86-b859-670eb41832d9 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:46.748592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239f27-b8c8-4f86-b859-670eb41832d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:46.748867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239f27-b8c8-4f86-b859-670eb41832d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:46.749628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31239f27-b8c8-4f86-b859-670eb41832d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:46.749937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31239f27-b8c8-4f86-b859-670eb41832d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:46.751343 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31239f27-b8c8-4f86-b859-670eb41832d9 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:46.758930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 587/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:09:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:46.764339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928323-ecf2-42e9-8a87-976ed37f14b4 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:46.857882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928323-ecf2-42e9-8a87-976ed37f14b4 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:46.889415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4637f2-402b-486e-b12e-1c38de53ebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:46.890236 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4637f2-402b-486e-b12e-1c38de53ebbd None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:46.890518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4637f2-402b-486e-b12e-1c38de53ebbd None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:46.890790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4637f2-402b-486e-b12e-1c38de53ebbd None admin] PATH_INFO: `/v3/users/f8891b93a0a2484482d4e32240501543` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:46.903612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4637f2-402b-486e-b12e-1c38de53ebbd None admin] RBAC: Authorizing `identity:get_user(user_id=f8891b93a0a2484482d4e32240501543)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:46.905050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4637f2-402b-486e-b12e-1c38de53ebbd None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:46.906669 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 595/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:46 2022] GET /identity/v3/users/f8891b93a0a2484482d4e32240501543 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:46.912250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239f27-b8c8-4f86-b859-670eb41832d9 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:47.007703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239f27-b8c8-4f86-b859-670eb41832d9 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:47.038525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aaf9f-78da-4dad-a388-c1d93399119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:47.039178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aaf9f-78da-4dad-a388-c1d93399119a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:47.039459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aaf9f-78da-4dad-a388-c1d93399119a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:47.039730 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aaf9f-78da-4dad-a388-c1d93399119a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:47.102208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710aaf9f-78da-4dad-a388-c1d93399119a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:47.103712 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710aaf9f-78da-4dad-a388-c1d93399119a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:47.195223 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 588/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:09:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:09:47.201231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4637f2-402b-486e-b12e-1c38de53ebbd None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:47.292568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4637f2-402b-486e-b12e-1c38de53ebbd None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:47.323844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214808f-0f60-457e-930a-96385133ea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:47.324670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214808f-0f60-457e-930a-96385133ea29 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:47.324950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214808f-0f60-457e-930a-96385133ea29 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:47.325220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214808f-0f60-457e-930a-96385133ea29 None admin] PATH_INFO: `/v3/projects/7377652c2dcc4e07bd41bf3fc3966c8a` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:47.326621 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214808f-0f60-457e-930a-96385133ea29 None admin] RBAC: Authorizing `identity:get_project(project_id=7377652c2dcc4e07bd41bf3fc3966c8a)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:47.328087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214808f-0f60-457e-930a-96385133ea29 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:47.329721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 596/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:09:47 2022] GET /identity/v3/projects/7377652c2dcc4e07bd41bf3fc3966c8a => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:47.335518 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aaf9f-78da-4dad-a388-c1d93399119a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:47.428526 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aaf9f-78da-4dad-a388-c1d93399119a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:47.461181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac82ca2-3558-451f-91cf-660986f0f90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:47.461767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac82ca2-3558-451f-91cf-660986f0f90f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:47.462050 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac82ca2-3558-451f-91cf-660986f0f90f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:47.462324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac82ca2-3558-451f-91cf-660986f0f90f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:47.463162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac82ca2-3558-451f-91cf-660986f0f90f None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=7377652c2dcc4e07bd41bf3fc3966c8a, user.id=f8891b93a0a2484482d4e32240501543) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:47.463476 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac82ca2-3558-451f-91cf-660986f0f90f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:47.464924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac82ca2-3558-451f-91cf-660986f0f90f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:47.470112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 589/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:09:47 2022] GET /identity/v3/role_assignments?user.id=f8891b93a0a2484482d4e32240501543&scope.project.id=7377652c2dcc4e07bd41bf3fc3966c8a&role.id=2791519d9bad43318f086666b6e64a20 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:49.615904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32cfc-897e-450d-ac75-b0a772eb93c7 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:49.616471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32cfc-897e-450d-ac75-b0a772eb93c7 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:49.616471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32cfc-897e-450d-ac75-b0a772eb93c7 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:49.618593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 597/1186] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:49.623968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6dc7-da82-4851-bec5-0465fa058c76 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:49.624368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6dc7-da82-4851-bec5-0465fa058c76 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:49.624519 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6dc7-da82-4851-bec5-0465fa058c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:49.640821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3ffd6dc7-da82-4851-bec5-0465fa058c76 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:49.641990 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3ffd6dc7-da82-4851-bec5-0465fa058c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:49.704084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 590/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:49.726007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32cfc-897e-450d-ac75-b0a772eb93c7 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:49.820470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32cfc-897e-450d-ac75-b0a772eb93c7 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:49.852866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daac8d6-77f4-44dd-b280-dbff5e6df057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:49.853645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daac8d6-77f4-44dd-b280-dbff5e6df057 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:49.853931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daac8d6-77f4-44dd-b280-dbff5e6df057 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:49.854210 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daac8d6-77f4-44dd-b280-dbff5e6df057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:49.864312 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daac8d6-77f4-44dd-b280-dbff5e6df057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-5daac8d6-77f4-44dd-b280-dbff5e6df057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:09:49.871967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:49.873061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:09:49.874127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 598/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:09:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:49.879475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd6dc7-da82-4851-bec5-0465fa058c76 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:49.977108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd6dc7-da82-4851-bec5-0465fa058c76 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:50.010496 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d46a0-331f-4bbd-83bd-d70c6569f73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:50.011191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d46a0-331f-4bbd-83bd-d70c6569f73b None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:50.011480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d46a0-331f-4bbd-83bd-d70c6569f73b None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:50.011757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d46a0-331f-4bbd-83bd-d70c6569f73b None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:50.012503 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d46a0-331f-4bbd-83bd-d70c6569f73b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:50.012812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d46a0-331f-4bbd-83bd-d70c6569f73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:50.014203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d46a0-331f-4bbd-83bd-d70c6569f73b None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:50.021919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 591/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:09:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:50.027900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daac8d6-77f4-44dd-b280-dbff5e6df057 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:50.121889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daac8d6-77f4-44dd-b280-dbff5e6df057 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:50.153338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22cd0-f2e0-49be-8401-59eca903baef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:50.154125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22cd0-f2e0-49be-8401-59eca903baef None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:50.154407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22cd0-f2e0-49be-8401-59eca903baef None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:50.154682 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22cd0-f2e0-49be-8401-59eca903baef None admin] PATH_INFO: `/v3/users/f8891b93a0a2484482d4e32240501543` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:50.156372 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe22cd0-f2e0-49be-8401-59eca903baef None admin] RBAC: Authorizing `identity:get_user(user_id=f8891b93a0a2484482d4e32240501543)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:50.157815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe22cd0-f2e0-49be-8401-59eca903baef None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:50.159448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 599/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:50 2022] GET /identity/v3/users/f8891b93a0a2484482d4e32240501543 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:50.165061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d46a0-331f-4bbd-83bd-d70c6569f73b None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:50.266897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d46a0-331f-4bbd-83bd-d70c6569f73b None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:50.298807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72abb4-e1d1-4298-9e33-d6ed59dbdd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:50.299683 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72abb4-e1d1-4298-9e33-d6ed59dbdd9c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:50.299964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72abb4-e1d1-4298-9e33-d6ed59dbdd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:50.300237 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72abb4-e1d1-4298-9e33-d6ed59dbdd9c None admin] PATH_INFO: `/v3/projects/7377652c2dcc4e07bd41bf3fc3966c8a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:50.301391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72abb4-e1d1-4298-9e33-d6ed59dbdd9c None admin] RBAC: Authorizing `identity:get_project(project_id=7377652c2dcc4e07bd41bf3fc3966c8a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:50.302836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72abb4-e1d1-4298-9e33-d6ed59dbdd9c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:50.304520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 592/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:09:50 2022] GET /identity/v3/projects/7377652c2dcc4e07bd41bf3fc3966c8a => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:50.310451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22cd0-f2e0-49be-8401-59eca903baef None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:50.402728 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22cd0-f2e0-49be-8401-59eca903baef None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:50.434169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009679f-6203-4684-ab54-f598105e4924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:50.434970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009679f-6203-4684-ab54-f598105e4924 None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:50.435281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009679f-6203-4684-ab54-f598105e4924 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:50.435553 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009679f-6203-4684-ab54-f598105e4924 None admin] PATH_INFO: `/v3/projects/7377652c2dcc4e07bd41bf3fc3966c8a/users/f8891b93a0a2484482d4e32240501543/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:50.437474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009679f-6203-4684-ab54-f598105e4924 None admin] RBAC: Authorizing `identity:create_grant(project_id=7377652c2dcc4e07bd41bf3fc3966c8a, user_id=f8891b93a0a2484482d4e32240501543, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:50.438897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009679f-6203-4684-ab54-f598105e4924 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:50.541137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 600/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:09:50 2022] PUT /identity/v3/projects/7377652c2dcc4e07bd41bf3fc3966c8a/users/f8891b93a0a2484482d4e32240501543/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:09:52.729116 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6724d-6b95-4cc3-b102-10c5bd25f7dc None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:52.729643 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6724d-6b95-4cc3-b102-10c5bd25f7dc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:52.729757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6724d-6b95-4cc3-b102-10c5bd25f7dc None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:52.731034 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 593/1193] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:09:52.736861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900590-4566-414f-91ef-0274145aa42b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:52.737280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900590-4566-414f-91ef-0274145aa42b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:52.737412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900590-4566-414f-91ef-0274145aa42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:52.753419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-dd900590-4566-414f-91ef-0274145aa42b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:09:52.754586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-dd900590-4566-414f-91ef-0274145aa42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:09:52.815670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 601/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:09:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:09:52.839603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6724d-6b95-4cc3-b102-10c5bd25f7dc None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:52.937887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6724d-6b95-4cc3-b102-10c5bd25f7dc None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:52.969343 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169020e1-25f4-4f05-ae4e-02b8172feb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:52.970122 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169020e1-25f4-4f05-ae4e-02b8172feb76 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:52.970404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169020e1-25f4-4f05-ae4e-02b8172feb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:52.970680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169020e1-25f4-4f05-ae4e-02b8172feb76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:52.980774 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169020e1-25f4-4f05-ae4e-02b8172feb76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-169020e1-25f4-4f05-ae4e-02b8172feb76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:09:52.989068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:09:52.990232 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:09:52.991615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 594/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:09:52.996145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd900590-4566-414f-91ef-0274145aa42b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:53.088480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd900590-4566-414f-91ef-0274145aa42b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:53.121080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f85e2-2897-4b15-8435-8280db162cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:53.121734 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f85e2-2897-4b15-8435-8280db162cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:53.122013 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f85e2-2897-4b15-8435-8280db162cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:53.122281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f85e2-2897-4b15-8435-8280db162cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:53.123017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f85e2-2897-4b15-8435-8280db162cf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:53.123349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f85e2-2897-4b15-8435-8280db162cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:53.125270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f85e2-2897-4b15-8435-8280db162cf7 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:53.132815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 602/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:09:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:09:53.138695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169020e1-25f4-4f05-ae4e-02b8172feb76 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:53.231958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169020e1-25f4-4f05-ae4e-02b8172feb76 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:53.263618 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d21d5f-42a8-49aa-a73f-35984821dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:53.264467 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21d5f-42a8-49aa-a73f-35984821dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:53.264742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21d5f-42a8-49aa-a73f-35984821dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:53.265011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21d5f-42a8-49aa-a73f-35984821dbd6 None admin] PATH_INFO: `/v3/users/f8891b93a0a2484482d4e32240501543` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:53.266183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d21d5f-42a8-49aa-a73f-35984821dbd6 None admin] RBAC: Authorizing `identity:get_user(user_id=f8891b93a0a2484482d4e32240501543)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:53.267669 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d21d5f-42a8-49aa-a73f-35984821dbd6 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:53.269242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 595/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Fri May 13 17:09:53 2022] GET /identity/v3/users/f8891b93a0a2484482d4e32240501543 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:53.274706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f85e2-2897-4b15-8435-8280db162cf7 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:53.370411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f85e2-2897-4b15-8435-8280db162cf7 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:53.400831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f80e41-eeb5-45c9-9984-f42fc848c11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:53.401461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f80e41-eeb5-45c9-9984-f42fc848c11d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:53.401741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f80e41-eeb5-45c9-9984-f42fc848c11d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:53.402013 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f80e41-eeb5-45c9-9984-f42fc848c11d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:53.463691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f80e41-eeb5-45c9-9984-f42fc848c11d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:53.465131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f80e41-eeb5-45c9-9984-f42fc848c11d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:53.555532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 603/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:09:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:09:53.561312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d21d5f-42a8-49aa-a73f-35984821dbd6 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:53.656160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d21d5f-42a8-49aa-a73f-35984821dbd6 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:53.688648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83b5ed-024f-4ae4-a0ec-3c088bfb1704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:53.689489 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83b5ed-024f-4ae4-a0ec-3c088bfb1704 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:53.689768 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83b5ed-024f-4ae4-a0ec-3c088bfb1704 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:53.690040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83b5ed-024f-4ae4-a0ec-3c088bfb1704 None admin] PATH_INFO: `/v3/projects/7377652c2dcc4e07bd41bf3fc3966c8a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:53.691213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83b5ed-024f-4ae4-a0ec-3c088bfb1704 None admin] RBAC: Authorizing `identity:get_project(project_id=7377652c2dcc4e07bd41bf3fc3966c8a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:53.692663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83b5ed-024f-4ae4-a0ec-3c088bfb1704 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:53.694328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 596/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Fri May 13 17:09:53 2022] GET /identity/v3/projects/7377652c2dcc4e07bd41bf3fc3966c8a => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:09:53.700335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f80e41-eeb5-45c9-9984-f42fc848c11d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:09:53.791654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f80e41-eeb5-45c9-9984-f42fc848c11d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:09:53.823568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff8e0f-770d-421b-9a1e-473a8a518913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:09:53.824141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8e0f-770d-421b-9a1e-473a8a518913 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:09:53.824419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8e0f-770d-421b-9a1e-473a8a518913 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:09:53.824688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8e0f-770d-421b-9a1e-473a8a518913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:09:53.825501 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff8e0f-770d-421b-9a1e-473a8a518913 None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=7377652c2dcc4e07bd41bf3fc3966c8a, user.id=f8891b93a0a2484482d4e32240501543) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:09:53.826059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff8e0f-770d-421b-9a1e-473a8a518913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:09:53.827507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff8e0f-770d-421b-9a1e-473a8a518913 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:09:53.833269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 604/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:09:53 2022] GET /identity/v3/role_assignments?user.id=f8891b93a0a2484482d4e32240501543&scope.project.id=7377652c2dcc4e07bd41bf3fc3966c8a&role.id=2791519d9bad43318f086666b6e64a20 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:09.781491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521fbf5-3703-4a2c-8ea1-2ca62f963b1a None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:09.782103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521fbf5-3703-4a2c-8ea1-2ca62f963b1a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:09.782103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521fbf5-3703-4a2c-8ea1-2ca62f963b1a None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:09.783964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 597/1201] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:11:09.789452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5e255-37ab-4b97-a008-6f29fe84fb85 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:09.790862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5e255-37ab-4b97-a008-6f29fe84fb85 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:09.790862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5e255-37ab-4b97-a008-6f29fe84fb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:09.806804 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c4c5e255-37ab-4b97-a008-6f29fe84fb85 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:11:09.808103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c4c5e255-37ab-4b97-a008-6f29fe84fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:11:09.871721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 605/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:11:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:11:09.897177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521fbf5-3703-4a2c-8ea1-2ca62f963b1a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:09.996092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521fbf5-3703-4a2c-8ea1-2ca62f963b1a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:10.028435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c80840-cd97-4514-9e0f-a5fd88027584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:10.029221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c80840-cd97-4514-9e0f-a5fd88027584 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:10.029502 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c80840-cd97-4514-9e0f-a5fd88027584 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:10.029776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c80840-cd97-4514-9e0f-a5fd88027584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:10.039727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c80840-cd97-4514-9e0f-a5fd88027584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:10.041133 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c80840-cd97-4514-9e0f-a5fd88027584 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-42c80840-cd97-4514-9e0f-a5fd88027584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:10.058722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:10.059999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:10.061352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:10.061352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:10.061352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:10.061352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:10.061352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 598/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:10.066678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5e255-37ab-4b97-a008-6f29fe84fb85 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:10.160585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5e255-37ab-4b97-a008-6f29fe84fb85 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:10.193412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd789-83a8-481b-9182-f5367e95df29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:10.194067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd789-83a8-481b-9182-f5367e95df29 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:10.194352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd789-83a8-481b-9182-f5367e95df29 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:10.194627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd789-83a8-481b-9182-f5367e95df29 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:10.195373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdd789-83a8-481b-9182-f5367e95df29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:10.195681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdd789-83a8-481b-9182-f5367e95df29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:10.197188 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdd789-83a8-481b-9182-f5367e95df29 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:10.208247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 606/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:10.213843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c80840-cd97-4514-9e0f-a5fd88027584 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:10.309985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c80840-cd97-4514-9e0f-a5fd88027584 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:10.341618 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee07894-0d4b-4f8b-9add-76792245f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:10.342278 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee07894-0d4b-4f8b-9add-76792245f3af None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:10.342562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee07894-0d4b-4f8b-9add-76792245f3af None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:10.342838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee07894-0d4b-4f8b-9add-76792245f3af None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:10.343575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee07894-0d4b-4f8b-9add-76792245f3af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:10.345077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee07894-0d4b-4f8b-9add-76792245f3af None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:10.454331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 599/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Fri May 13 17:11:10 2022] POST /identity/v3/users => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:11:12.682612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce3f31-6594-4e37-b569-ec7858803628 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:12.683198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce3f31-6594-4e37-b569-ec7858803628 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:12.683198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce3f31-6594-4e37-b569-ec7858803628 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:12.684579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 607/1206] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:11:12.689736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a9372-b517-4d26-b753-ec530e7d0437 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:12.690158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a9372-b517-4d26-b753-ec530e7d0437 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:12.690293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a9372-b517-4d26-b753-ec530e7d0437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:12.707955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a87a9372-b517-4d26-b753-ec530e7d0437 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:11:12.709120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a87a9372-b517-4d26-b753-ec530e7d0437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:11:12.772694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 600/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:11:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:11:12.795984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce3f31-6594-4e37-b569-ec7858803628 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:12.898411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce3f31-6594-4e37-b569-ec7858803628 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:12.931663 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2cdac-a549-40e5-9aa9-04d2188a7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:12.932451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2cdac-a549-40e5-9aa9-04d2188a7b28 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:12.932790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2cdac-a549-40e5-9aa9-04d2188a7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:12.933049 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2cdac-a549-40e5-9aa9-04d2188a7b28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:12.943375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2cdac-a549-40e5-9aa9-04d2188a7b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-76a2cdac-a549-40e5-9aa9-04d2188a7b28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:11:12.951377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:12.952770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:12.953692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 608/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:11:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:12.959497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a9372-b517-4d26-b753-ec530e7d0437 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:13.063831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a9372-b517-4d26-b753-ec530e7d0437 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:13.098230 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64dcfc-6b4b-4a9a-8b7a-581ab3fbfb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:13.098930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64dcfc-6b4b-4a9a-8b7a-581ab3fbfb95 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:13.099239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64dcfc-6b4b-4a9a-8b7a-581ab3fbfb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:13.099517 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64dcfc-6b4b-4a9a-8b7a-581ab3fbfb95 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:13.100260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64dcfc-6b4b-4a9a-8b7a-581ab3fbfb95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:13.100565 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64dcfc-6b4b-4a9a-8b7a-581ab3fbfb95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:13.101955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64dcfc-6b4b-4a9a-8b7a-581ab3fbfb95 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:13.109586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 601/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:11:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:13.115379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2cdac-a549-40e5-9aa9-04d2188a7b28 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:13.211105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2cdac-a549-40e5-9aa9-04d2188a7b28 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:13.243731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bde06-893a-4218-992a-7d088ea18936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:13.244512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bde06-893a-4218-992a-7d088ea18936 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:13.244799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bde06-893a-4218-992a-7d088ea18936 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:13.245076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bde06-893a-4218-992a-7d088ea18936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:13.255186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bde06-893a-4218-992a-7d088ea18936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:13.256663 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bde06-893a-4218-992a-7d088ea18936 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-928bde06-893a-4218-992a-7d088ea18936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:13.274838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:13.275942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:13.277367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:13.277367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:13.277367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:13.277367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:13.277367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 609/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:13.281918 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64dcfc-6b4b-4a9a-8b7a-581ab3fbfb95 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:13.378579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64dcfc-6b4b-4a9a-8b7a-581ab3fbfb95 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:13.412098 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186277-d576-43e7-b0c7-ea7e8b645a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:13.412746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186277-d576-43e7-b0c7-ea7e8b645a82 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:13.413069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186277-d576-43e7-b0c7-ea7e8b645a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:13.413340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186277-d576-43e7-b0c7-ea7e8b645a82 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:13.414071 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186277-d576-43e7-b0c7-ea7e8b645a82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:13.414373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186277-d576-43e7-b0c7-ea7e8b645a82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:13.415844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186277-d576-43e7-b0c7-ea7e8b645a82 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:13.427195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 602/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:13.432914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bde06-893a-4218-992a-7d088ea18936 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:13.530305 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bde06-893a-4218-992a-7d088ea18936 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:13.561682 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d0ca9-3a7b-4427-96d9-9c29e5d0eb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:13.562473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d0ca9-3a7b-4427-96d9-9c29e5d0eb48 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:13.562760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d0ca9-3a7b-4427-96d9-9c29e5d0eb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:13.563040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d0ca9-3a7b-4427-96d9-9c29e5d0eb48 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:13.570801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d0ca9-3a7b-4427-96d9-9c29e5d0eb48 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:13.572294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d0ca9-3a7b-4427-96d9-9c29e5d0eb48 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-da1d0ca9-3a7b-4427-96d9-9c29e5d0eb48 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:11:13.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:13.588301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:13.589408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:13.589408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:13.589408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:11:13.589408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:11:13.589408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:11:13.589408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:11:13.589408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:11:13.589408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:11:13.589408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:13.589408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:13.589408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 610/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:11:13.594373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186277-d576-43e7-b0c7-ea7e8b645a82 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:13.688345 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186277-d576-43e7-b0c7-ea7e8b645a82 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:13.721055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394aac0-6040-4a6a-9e54-9ce86d04536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:13.721722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394aac0-6040-4a6a-9e54-9ce86d04536c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:13.722003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394aac0-6040-4a6a-9e54-9ce86d04536c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:13.722276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394aac0-6040-4a6a-9e54-9ce86d04536c None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:13.723098 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394aac0-6040-4a6a-9e54-9ce86d04536c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:13.723436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394aac0-6040-4a6a-9e54-9ce86d04536c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:13.724886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394aac0-6040-4a6a-9e54-9ce86d04536c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:13.742069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 603/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Fri May 13 17:11:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:13.747891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d0ca9-3a7b-4427-96d9-9c29e5d0eb48 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:13.844156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d0ca9-3a7b-4427-96d9-9c29e5d0eb48 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:13.877458 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573747b-9ca5-410a-8ee9-0613411d69d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:13.878101 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573747b-9ca5-410a-8ee9-0613411d69d1 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:13.878406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573747b-9ca5-410a-8ee9-0613411d69d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:13.878714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573747b-9ca5-410a-8ee9-0613411d69d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:13.943020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573747b-9ca5-410a-8ee9-0613411d69d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:13.944539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573747b-9ca5-410a-8ee9-0613411d69d1 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:14.042298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 611/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:11:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:11:14.048144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394aac0-6040-4a6a-9e54-9ce86d04536c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:14.142020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394aac0-6040-4a6a-9e54-9ce86d04536c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:14.174597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e73cf-61ae-44ff-bdb1-9701812fb637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:14.175403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e73cf-61ae-44ff-bdb1-9701812fb637 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:14.175679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e73cf-61ae-44ff-bdb1-9701812fb637 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:14.175949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e73cf-61ae-44ff-bdb1-9701812fb637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:14.185370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e73cf-61ae-44ff-bdb1-9701812fb637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:14.186811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e73cf-61ae-44ff-bdb1-9701812fb637 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-406e73cf-61ae-44ff-bdb1-9701812fb637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:14.205014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:14.208974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:14.210099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:14.210099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:14.210099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:14.210099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:14.210099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 604/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:11:14.211938 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573747b-9ca5-410a-8ee9-0613411d69d1 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:14.307600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573747b-9ca5-410a-8ee9-0613411d69d1 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:14.339841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7dc0-427d-4149-8930-a02abd87c29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:14.340494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7dc0-427d-4149-8930-a02abd87c29d None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:14.340778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7dc0-427d-4149-8930-a02abd87c29d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:14.341054 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7dc0-427d-4149-8930-a02abd87c29d None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:14.341771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e7dc0-427d-4149-8930-a02abd87c29d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:14.342080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e7dc0-427d-4149-8930-a02abd87c29d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:14.343496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e7dc0-427d-4149-8930-a02abd87c29d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:14.354960 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 612/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:14.360626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e73cf-61ae-44ff-bdb1-9701812fb637 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:14.458475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e73cf-61ae-44ff-bdb1-9701812fb637 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:14.491280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfec9b-2a4c-4c3f-9d5f-fcbd6a3ac55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:14.492064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfec9b-2a4c-4c3f-9d5f-fcbd6a3ac55d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:14.492342 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfec9b-2a4c-4c3f-9d5f-fcbd6a3ac55d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:14.492610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfec9b-2a4c-4c3f-9d5f-fcbd6a3ac55d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:14.498976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfec9b-2a4c-4c3f-9d5f-fcbd6a3ac55d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:14.500461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfec9b-2a4c-4c3f-9d5f-fcbd6a3ac55d None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-d6bfec9b-2a4c-4c3f-9d5f-fcbd6a3ac55d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:11:14.514259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:14.515425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:14.516374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:11:14.516374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:11:14.516374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:11:14.516374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:11:14.516374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:11:14.516374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:11:14.516374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:14.516374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:14.516374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 605/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:11:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:14.521290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7dc0-427d-4149-8930-a02abd87c29d None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:14.616562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7dc0-427d-4149-8930-a02abd87c29d None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:14.655508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c38976-c1d3-4a2d-b6b8-5b894ec8cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:14.656165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38976-c1d3-4a2d-b6b8-5b894ec8cd31 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:14.656456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38976-c1d3-4a2d-b6b8-5b894ec8cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:14.656727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38976-c1d3-4a2d-b6b8-5b894ec8cd31 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:14.657510 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c38976-c1d3-4a2d-b6b8-5b894ec8cd31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:14.657819 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c38976-c1d3-4a2d-b6b8-5b894ec8cd31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:14.659298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c38976-c1d3-4a2d-b6b8-5b894ec8cd31 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:14.670792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 613/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:11:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:14.677455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfec9b-2a4c-4c3f-9d5f-fcbd6a3ac55d None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:14.774537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfec9b-2a4c-4c3f-9d5f-fcbd6a3ac55d None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:14.807730 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3882eb-76ae-4d88-a3e0-0f0ef4b1b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:14.808377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3882eb-76ae-4d88-a3e0-0f0ef4b1b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:14.808660 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3882eb-76ae-4d88-a3e0-0f0ef4b1b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:14.808937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3882eb-76ae-4d88-a3e0-0f0ef4b1b2c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:14.809761 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3882eb-76ae-4d88-a3e0-0f0ef4b1b2c8 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=b84ae21424694df68a96b928e15e9240) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:14.810073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3882eb-76ae-4d88-a3e0-0f0ef4b1b2c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:14.811553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3882eb-76ae-4d88-a3e0-0f0ef4b1b2c8 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:14.816889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 606/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:11:14 2022] GET /identity/v3/role_assignments?user.id=b84ae21424694df68a96b928e15e9240&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:17.039825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778d4f9-4787-4b29-aa5c-d1212fafdb5c None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:17.040400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778d4f9-4787-4b29-aa5c-d1212fafdb5c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:17.040400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778d4f9-4787-4b29-aa5c-d1212fafdb5c None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:17.041743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 614/1220] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:11:17.047045 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3721f4d-fa7f-4ace-92a8-257ace18b31d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:17.047522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3721f4d-fa7f-4ace-92a8-257ace18b31d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:17.047622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3721f4d-fa7f-4ace-92a8-257ace18b31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:17.064334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e3721f4d-fa7f-4ace-92a8-257ace18b31d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:11:17.066831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e3721f4d-fa7f-4ace-92a8-257ace18b31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:11:17.135535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 607/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:11:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:11:17.158353 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778d4f9-4787-4b29-aa5c-d1212fafdb5c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:17.254499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778d4f9-4787-4b29-aa5c-d1212fafdb5c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:17.286222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52958c9-8dcb-4cfb-be61-c5fa888b65f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:17.287011 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52958c9-8dcb-4cfb-be61-c5fa888b65f5 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:17.287323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52958c9-8dcb-4cfb-be61-c5fa888b65f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:17.287603 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52958c9-8dcb-4cfb-be61-c5fa888b65f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:17.297468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52958c9-8dcb-4cfb-be61-c5fa888b65f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-e52958c9-8dcb-4cfb-be61-c5fa888b65f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:11:17.305086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:17.306264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:17.307359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 615/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:11:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:17.312220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3721f4d-fa7f-4ace-92a8-257ace18b31d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:17.407572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3721f4d-fa7f-4ace-92a8-257ace18b31d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:17.440367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d31665-4991-4ab5-825e-0a1e15599d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:17.441025 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d31665-4991-4ab5-825e-0a1e15599d25 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:17.441303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d31665-4991-4ab5-825e-0a1e15599d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:17.441574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d31665-4991-4ab5-825e-0a1e15599d25 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:17.442305 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d31665-4991-4ab5-825e-0a1e15599d25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:17.442606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d31665-4991-4ab5-825e-0a1e15599d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:17.444020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d31665-4991-4ab5-825e-0a1e15599d25 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:17.451619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 608/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:11:17.457766 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52958c9-8dcb-4cfb-be61-c5fa888b65f5 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:17.553413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52958c9-8dcb-4cfb-be61-c5fa888b65f5 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:17.586460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60321b-b31a-478a-9a51-f24110caed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:17.587274 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60321b-b31a-478a-9a51-f24110caed6c None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:17.587561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60321b-b31a-478a-9a51-f24110caed6c None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:17.587839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60321b-b31a-478a-9a51-f24110caed6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:17.598192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60321b-b31a-478a-9a51-f24110caed6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:17.599688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60321b-b31a-478a-9a51-f24110caed6c None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-9c60321b-b31a-478a-9a51-f24110caed6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:17.616954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:17.618017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:17.619369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:17.619369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:17.619369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:17.619369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:17.619369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 616/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:17.623895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d31665-4991-4ab5-825e-0a1e15599d25 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:17.723451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d31665-4991-4ab5-825e-0a1e15599d25 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:17.756025 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7bb1-7922-4b84-a2de-0bc8e3598c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:17.756675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7bb1-7922-4b84-a2de-0bc8e3598c3a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:17.756958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7bb1-7922-4b84-a2de-0bc8e3598c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:17.757234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7bb1-7922-4b84-a2de-0bc8e3598c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:17.757948 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7bb1-7922-4b84-a2de-0bc8e3598c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:17.758255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7bb1-7922-4b84-a2de-0bc8e3598c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:17.759671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7bb1-7922-4b84-a2de-0bc8e3598c3a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:17.770917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 609/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:17.776720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60321b-b31a-478a-9a51-f24110caed6c None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:17.874230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60321b-b31a-478a-9a51-f24110caed6c None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:17.905696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37832650-55c4-4575-9437-56a233aa7492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:17.906494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37832650-55c4-4575-9437-56a233aa7492 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:17.906775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37832650-55c4-4575-9437-56a233aa7492 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:17.907047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37832650-55c4-4575-9437-56a233aa7492 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:17.914722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37832650-55c4-4575-9437-56a233aa7492 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:17.916214 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37832650-55c4-4575-9437-56a233aa7492 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-37832650-55c4-4575-9437-56a233aa7492 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:11:17.930664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:17.931771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:17.932741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:17.932741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:17.932741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:11:17.932741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:11:17.932741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:11:17.932741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:11:17.932741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:11:17.932741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:11:17.932741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:17.932741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:17.932741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 617/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:17.937630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7bb1-7922-4b84-a2de-0bc8e3598c3a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:18.051950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7bb1-7922-4b84-a2de-0bc8e3598c3a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:18.084444 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a448e94-ab9c-4b88-aca0-a062f805f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:18.085107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448e94-ab9c-4b88-aca0-a062f805f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:18.085384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448e94-ab9c-4b88-aca0-a062f805f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:18.085653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448e94-ab9c-4b88-aca0-a062f805f9c0 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:18.086468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a448e94-ab9c-4b88-aca0-a062f805f9c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:18.086769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a448e94-ab9c-4b88-aca0-a062f805f9c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:18.088247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a448e94-ab9c-4b88-aca0-a062f805f9c0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:18.105112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 610/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Fri May 13 17:11:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:18.111568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37832650-55c4-4575-9437-56a233aa7492 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:18.207684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37832650-55c4-4575-9437-56a233aa7492 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:18.240819 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c51202-a868-4e7a-b540-8221d7d939b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:18.241678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c51202-a868-4e7a-b540-8221d7d939b5 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:18.241899 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c51202-a868-4e7a-b540-8221d7d939b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:18.242177 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c51202-a868-4e7a-b540-8221d7d939b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:18.252895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c51202-a868-4e7a-b540-8221d7d939b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:18.254346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c51202-a868-4e7a-b540-8221d7d939b5 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-96c51202-a868-4e7a-b540-8221d7d939b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:18.271050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:18.272165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:18.273486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:18.273486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:18.273486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:18.273486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:18.273486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 618/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:11:18.277978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a448e94-ab9c-4b88-aca0-a062f805f9c0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:18.383888 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a448e94-ab9c-4b88-aca0-a062f805f9c0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:18.416308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aa5bf-3470-48c4-ba64-d2fbc08c40f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:18.417022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa5bf-3470-48c4-ba64-d2fbc08c40f0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:18.417304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa5bf-3470-48c4-ba64-d2fbc08c40f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:18.417576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa5bf-3470-48c4-ba64-d2fbc08c40f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:18.418285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aa5bf-3470-48c4-ba64-d2fbc08c40f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:18.418591 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aa5bf-3470-48c4-ba64-d2fbc08c40f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:18.420015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aa5bf-3470-48c4-ba64-d2fbc08c40f0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:18.431575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 611/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:18.437212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c51202-a868-4e7a-b540-8221d7d939b5 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:18.533181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c51202-a868-4e7a-b540-8221d7d939b5 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:18.565567 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974b3d8-3392-441b-b268-f78bd866d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:18.566378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b3d8-3392-441b-b268-f78bd866d1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:18.566656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b3d8-3392-441b-b268-f78bd866d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:18.567005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b3d8-3392-441b-b268-f78bd866d1e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:18.573504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974b3d8-3392-441b-b268-f78bd866d1e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:18.574964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974b3d8-3392-441b-b268-f78bd866d1e5 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-5974b3d8-3392-441b-b268-f78bd866d1e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:11:18.589705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:18.592692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:18.593853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:11:18.593853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:11:18.593853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:11:18.593853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:11:18.593853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:11:18.593853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:11:18.593853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:18.593853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:18.593853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 619/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:11:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:18.596800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aa5bf-3470-48c4-ba64-d2fbc08c40f0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:18.692871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aa5bf-3470-48c4-ba64-d2fbc08c40f0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:18.728868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4effa0-8b8a-4a59-96d2-a1a5f1f6f8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:18.729569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4effa0-8b8a-4a59-96d2-a1a5f1f6f8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:18.729846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4effa0-8b8a-4a59-96d2-a1a5f1f6f8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:18.730113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4effa0-8b8a-4a59-96d2-a1a5f1f6f8e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:18.730886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4effa0-8b8a-4a59-96d2-a1a5f1f6f8e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:18.731216 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4effa0-8b8a-4a59-96d2-a1a5f1f6f8e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:18.732683 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4effa0-8b8a-4a59-96d2-a1a5f1f6f8e8 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:18.744168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 612/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:11:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:18.750364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974b3d8-3392-441b-b268-f78bd866d1e5 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:18.844789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974b3d8-3392-441b-b268-f78bd866d1e5 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:18.876878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2503b-8d42-45f7-8d34-c0d5924ee81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:18.877744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2503b-8d42-45f7-8d34-c0d5924ee81d None admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:18.878021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2503b-8d42-45f7-8d34-c0d5924ee81d None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:18.878327 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2503b-8d42-45f7-8d34-c0d5924ee81d None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/b84ae21424694df68a96b928e15e9240/roles/7e1ae9fbefc24173bab81ecbd3889e94` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:18.891710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2503b-8d42-45f7-8d34-c0d5924ee81d None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=b84ae21424694df68a96b928e15e9240, role_id=7e1ae9fbefc24173bab81ecbd3889e94)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:18.899558 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2503b-8d42-45f7-8d34-c0d5924ee81d None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:18.974570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 620/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:11:18 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/b84ae21424694df68a96b928e15e9240/roles/7e1ae9fbefc24173bab81ecbd3889e94 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:11:21.154204 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f67383-590b-4fcc-9b6e-fb717a0899f7 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:21.154746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f67383-590b-4fcc-9b6e-fb717a0899f7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:21.154879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f67383-590b-4fcc-9b6e-fb717a0899f7 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:21.156379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 613/1233] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:11:21.161751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52516e3d-dbe4-4f42-9dd3-cb9e5c402715 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:21.162124 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52516e3d-dbe4-4f42-9dd3-cb9e5c402715 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:21.162310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52516e3d-dbe4-4f42-9dd3-cb9e5c402715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:21.179533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-52516e3d-dbe4-4f42-9dd3-cb9e5c402715 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:11:21.189363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-52516e3d-dbe4-4f42-9dd3-cb9e5c402715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:11:21.243807 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 621/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:11:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:11:21.267737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f67383-590b-4fcc-9b6e-fb717a0899f7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:21.364214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f67383-590b-4fcc-9b6e-fb717a0899f7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:21.397046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bed8d-9d11-4bcd-a670-2d1c1c308bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:21.397840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bed8d-9d11-4bcd-a670-2d1c1c308bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:21.398122 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bed8d-9d11-4bcd-a670-2d1c1c308bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:21.398399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bed8d-9d11-4bcd-a670-2d1c1c308bc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:21.408209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bed8d-9d11-4bcd-a670-2d1c1c308bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-fa4bed8d-9d11-4bcd-a670-2d1c1c308bc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:11:21.415927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:21.418428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:21.419521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 614/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Fri May 13 17:11:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:21.423678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52516e3d-dbe4-4f42-9dd3-cb9e5c402715 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:21.517540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52516e3d-dbe4-4f42-9dd3-cb9e5c402715 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:21.550117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b4f2c-292f-4382-b790-63f3ecfb0a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:21.550766 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b4f2c-292f-4382-b790-63f3ecfb0a7a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:21.551049 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b4f2c-292f-4382-b790-63f3ecfb0a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:21.551355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b4f2c-292f-4382-b790-63f3ecfb0a7a None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:21.552095 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b4f2c-292f-4382-b790-63f3ecfb0a7a None admin] RBAC: Adding query filter params (name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:21.552406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b4f2c-292f-4382-b790-63f3ecfb0a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:21.553778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b4f2c-292f-4382-b790-63f3ecfb0a7a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:21.561474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 622/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Fri May 13 17:11:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:21.567267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bed8d-9d11-4bcd-a670-2d1c1c308bc4 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:21.662527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bed8d-9d11-4bcd-a670-2d1c1c308bc4 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:21.694641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36705a6-00ad-439b-b77a-b12c893fdb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:21.695448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36705a6-00ad-439b-b77a-b12c893fdb7c None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:21.695731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36705a6-00ad-439b-b77a-b12c893fdb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:21.696002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36705a6-00ad-439b-b77a-b12c893fdb7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:21.707582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36705a6-00ad-439b-b77a-b12c893fdb7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:21.709121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36705a6-00ad-439b-b77a-b12c893fdb7c None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-b36705a6-00ad-439b-b77a-b12c893fdb7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:21.726249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:21.727416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:21.728548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:21.728548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:21.728548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:21.728548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:21.728548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 615/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:21.733152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b4f2c-292f-4382-b790-63f3ecfb0a7a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:21.834102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b4f2c-292f-4382-b790-63f3ecfb0a7a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:21.866704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e4d22-62e6-42b9-9454-17da063fe009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:21.867401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e4d22-62e6-42b9-9454-17da063fe009 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:21.867684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e4d22-62e6-42b9-9454-17da063fe009 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:21.867957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e4d22-62e6-42b9-9454-17da063fe009 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:21.868673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e4d22-62e6-42b9-9454-17da063fe009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:21.868973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e4d22-62e6-42b9-9454-17da063fe009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:21.870397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e4d22-62e6-42b9-9454-17da063fe009 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:21.881710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 623/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:21.887406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36705a6-00ad-439b-b77a-b12c893fdb7c None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:21.984728 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36705a6-00ad-439b-b77a-b12c893fdb7c None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:22.016658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d528f1-8c77-482a-bb62-d46af8bff678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:22.018024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d528f1-8c77-482a-bb62-d46af8bff678 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:22.018336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d528f1-8c77-482a-bb62-d46af8bff678 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:22.018648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d528f1-8c77-482a-bb62-d46af8bff678 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:22.028451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d528f1-8c77-482a-bb62-d46af8bff678 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:22.029984 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d528f1-8c77-482a-bb62-d46af8bff678 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-99d528f1-8c77-482a-bb62-d46af8bff678 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:11:22.050430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:22.051789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:22.052981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:22.052981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:22.052981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:11:22.052981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:11:22.052981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:11:22.052981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:11:22.052981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:11:22.052981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:11:22.052981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:22.052981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:22.052981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 616/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:22.059727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e4d22-62e6-42b9-9454-17da063fe009 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:22.154670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e4d22-62e6-42b9-9454-17da063fe009 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:22.186736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48564b8f-7869-4a22-9279-5ca5a1f8d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:22.187429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564b8f-7869-4a22-9279-5ca5a1f8d01f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:22.187712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564b8f-7869-4a22-9279-5ca5a1f8d01f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:22.187986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564b8f-7869-4a22-9279-5ca5a1f8d01f None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:22.188840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48564b8f-7869-4a22-9279-5ca5a1f8d01f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:22.189148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48564b8f-7869-4a22-9279-5ca5a1f8d01f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:22.190574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48564b8f-7869-4a22-9279-5ca5a1f8d01f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:22.207558 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 624/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Fri May 13 17:11:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:22.213237 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d528f1-8c77-482a-bb62-d46af8bff678 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:22.310512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d528f1-8c77-482a-bb62-d46af8bff678 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:22.342411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc31b9-3967-43b7-9dc0-8f6671d681c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:22.343056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc31b9-3967-43b7-9dc0-8f6671d681c4 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:22.343367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc31b9-3967-43b7-9dc0-8f6671d681c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:22.343688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc31b9-3967-43b7-9dc0-8f6671d681c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:22.407882 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc31b9-3967-43b7-9dc0-8f6671d681c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:22.409363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc31b9-3967-43b7-9dc0-8f6671d681c4 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:22.502306 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 617/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:11:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:11:22.508207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48564b8f-7869-4a22-9279-5ca5a1f8d01f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:22.603879 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48564b8f-7869-4a22-9279-5ca5a1f8d01f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:22.636407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29085dff-1ea9-4d5e-897c-97168d002597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:22.637187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29085dff-1ea9-4d5e-897c-97168d002597 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:22.637472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29085dff-1ea9-4d5e-897c-97168d002597 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:22.637747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29085dff-1ea9-4d5e-897c-97168d002597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:22.648155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29085dff-1ea9-4d5e-897c-97168d002597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:22.649620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29085dff-1ea9-4d5e-897c-97168d002597 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-29085dff-1ea9-4d5e-897c-97168d002597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:22.667348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:22.668404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:22.669522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:22.669522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:22.669522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:22.669522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:22.669522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 625/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:22.674790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc31b9-3967-43b7-9dc0-8f6671d681c4 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:22.769840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc31b9-3967-43b7-9dc0-8f6671d681c4 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:22.802969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca90a3f-a30b-4a25-8da8-2cdaaa4a6ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:22.803650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90a3f-a30b-4a25-8da8-2cdaaa4a6ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:22.803933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90a3f-a30b-4a25-8da8-2cdaaa4a6ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:22.804208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90a3f-a30b-4a25-8da8-2cdaaa4a6ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:22.804915 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca90a3f-a30b-4a25-8da8-2cdaaa4a6ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:22.805222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca90a3f-a30b-4a25-8da8-2cdaaa4a6ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:22.806601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca90a3f-a30b-4a25-8da8-2cdaaa4a6ac7 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:22.817843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 618/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:22.823533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29085dff-1ea9-4d5e-897c-97168d002597 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:22.918407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29085dff-1ea9-4d5e-897c-97168d002597 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:22.951802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450fe5-3138-4e6d-9a9b-fadb04ba1755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:22.952884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450fe5-3138-4e6d-9a9b-fadb04ba1755 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:22.953172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450fe5-3138-4e6d-9a9b-fadb04ba1755 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:22.953448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450fe5-3138-4e6d-9a9b-fadb04ba1755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:22.960415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450fe5-3138-4e6d-9a9b-fadb04ba1755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:22.961917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450fe5-3138-4e6d-9a9b-fadb04ba1755 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-b3450fe5-3138-4e6d-9a9b-fadb04ba1755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:11:22.975644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:22.976691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:22.977619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:11:22.977619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:11:22.977619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:11:22.977619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:11:22.977619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:11:22.977619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:11:22.977619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:22.977619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:22.977619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 626/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:11:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:22.982674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca90a3f-a30b-4a25-8da8-2cdaaa4a6ac7 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:23.080278 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca90a3f-a30b-4a25-8da8-2cdaaa4a6ac7 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:23.113589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86195e98-cd85-4992-9bfb-cfb5ce583b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:23.114647 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195e98-cd85-4992-9bfb-cfb5ce583b12 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:23.115091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195e98-cd85-4992-9bfb-cfb5ce583b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:23.115407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195e98-cd85-4992-9bfb-cfb5ce583b12 None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:23.116273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86195e98-cd85-4992-9bfb-cfb5ce583b12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:23.121442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86195e98-cd85-4992-9bfb-cfb5ce583b12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:23.121442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86195e98-cd85-4992-9bfb-cfb5ce583b12 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:23.131993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 619/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:11:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:23.137943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450fe5-3138-4e6d-9a9b-fadb04ba1755 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:23.234888 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450fe5-3138-4e6d-9a9b-fadb04ba1755 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:23.266664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e0651-74ca-4a87-89f8-bb5bc462a0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:23.267347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e0651-74ca-4a87-89f8-bb5bc462a0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:23.267630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e0651-74ca-4a87-89f8-bb5bc462a0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:23.267900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e0651-74ca-4a87-89f8-bb5bc462a0d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:23.268727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e0651-74ca-4a87-89f8-bb5bc462a0d0 None admin] RBAC: Adding query filter params (role.id=7e1ae9fbefc24173bab81ecbd3889e94, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=b84ae21424694df68a96b928e15e9240) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:23.269040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e0651-74ca-4a87-89f8-bb5bc462a0d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:23.270520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e0651-74ca-4a87-89f8-bb5bc462a0d0 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:23.276246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 627/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:11:23 2022] GET /identity/v3/role_assignments?user.id=b84ae21424694df68a96b928e15e9240&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=7e1ae9fbefc24173bab81ecbd3889e94 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:25.593743 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d81e3-e78d-47d8-bdb6-18e345a24ada None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:25.594314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d81e3-e78d-47d8-bdb6-18e345a24ada None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:25.594314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d81e3-e78d-47d8-bdb6-18e345a24ada None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:25.596234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 620/1247] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:11:25.601585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de36b-0429-472b-8f97-680e53b55b0c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:25.602028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de36b-0429-472b-8f97-680e53b55b0c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:25.602136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de36b-0429-472b-8f97-680e53b55b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:25.619051 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-777de36b-0429-472b-8f97-680e53b55b0c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:11:25.620280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-777de36b-0429-472b-8f97-680e53b55b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:11:25.683942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 628/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:11:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:11:25.707439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d81e3-e78d-47d8-bdb6-18e345a24ada None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:25.802965 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d81e3-e78d-47d8-bdb6-18e345a24ada None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:25.835655 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0729ff-3fbf-4b76-b794-d391164338a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:25.836470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0729ff-3fbf-4b76-b794-d391164338a8 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:25.836750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0729ff-3fbf-4b76-b794-d391164338a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:25.837024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0729ff-3fbf-4b76-b794-d391164338a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:25.847409 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0729ff-3fbf-4b76-b794-d391164338a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-ab0729ff-3fbf-4b76-b794-d391164338a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:11:25.855169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:25.856348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:25.857282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 621/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:11:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:25.862331 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777de36b-0429-472b-8f97-680e53b55b0c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:25.959496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777de36b-0429-472b-8f97-680e53b55b0c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:25.993028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97032dcb-79e0-4f35-8c65-28bcfd8a600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:25.993694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97032dcb-79e0-4f35-8c65-28bcfd8a600b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:25.993980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97032dcb-79e0-4f35-8c65-28bcfd8a600b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:25.994260 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97032dcb-79e0-4f35-8c65-28bcfd8a600b None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:25.995185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97032dcb-79e0-4f35-8c65-28bcfd8a600b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:25.995512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97032dcb-79e0-4f35-8c65-28bcfd8a600b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:25.996894 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97032dcb-79e0-4f35-8c65-28bcfd8a600b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:26.005162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 629/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:11:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:26.010835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0729ff-3fbf-4b76-b794-d391164338a8 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:26.109410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0729ff-3fbf-4b76-b794-d391164338a8 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:26.142992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c290b-1623-4eb8-8b94-526730de614f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:26.143853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c290b-1623-4eb8-8b94-526730de614f None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:26.144136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c290b-1623-4eb8-8b94-526730de614f None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:26.144410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c290b-1623-4eb8-8b94-526730de614f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:26.154889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c290b-1623-4eb8-8b94-526730de614f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:26.156475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c290b-1623-4eb8-8b94-526730de614f None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-ff1c290b-1623-4eb8-8b94-526730de614f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:26.173511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:26.174654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:26.175792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:26.175792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:26.175792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:26.175792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:26.175792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 622/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:26.180444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97032dcb-79e0-4f35-8c65-28bcfd8a600b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:26.278219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97032dcb-79e0-4f35-8c65-28bcfd8a600b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:26.309544 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a361725-7df6-48a9-ba77-037a2b4a60aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:26.310196 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a361725-7df6-48a9-ba77-037a2b4a60aa None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:26.310477 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a361725-7df6-48a9-ba77-037a2b4a60aa None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:26.310749 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a361725-7df6-48a9-ba77-037a2b4a60aa None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:26.311555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a361725-7df6-48a9-ba77-037a2b4a60aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:26.311854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a361725-7df6-48a9-ba77-037a2b4a60aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:26.313220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a361725-7df6-48a9-ba77-037a2b4a60aa None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:26.324935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 630/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:26.331489 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c290b-1623-4eb8-8b94-526730de614f None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:26.426543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c290b-1623-4eb8-8b94-526730de614f None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:26.463493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4f34-5c68-4302-a234-af64ca149524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:26.464302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4f34-5c68-4302-a234-af64ca149524 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:26.464583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4f34-5c68-4302-a234-af64ca149524 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:26.464857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4f34-5c68-4302-a234-af64ca149524 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:26.473360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c4f34-5c68-4302-a234-af64ca149524 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:26.474835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c4f34-5c68-4302-a234-af64ca149524 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-054c4f34-5c68-4302-a234-af64ca149524 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:11:26.489685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:26.493470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:26.494661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:26.494661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:26.494661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:11:26.494661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:11:26.494661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:11:26.494661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:11:26.494661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:11:26.494661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:11:26.494661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:26.494661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:26.494661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 623/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:26.496734 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a361725-7df6-48a9-ba77-037a2b4a60aa None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:26.591016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a361725-7df6-48a9-ba77-037a2b4a60aa None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:26.623332 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae20aa-79a8-47c1-a2da-be17e288ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:26.623996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae20aa-79a8-47c1-a2da-be17e288ef4b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:26.624278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae20aa-79a8-47c1-a2da-be17e288ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:26.624551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae20aa-79a8-47c1-a2da-be17e288ef4b None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:26.625377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae20aa-79a8-47c1-a2da-be17e288ef4b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:26.625681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae20aa-79a8-47c1-a2da-be17e288ef4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:26.627754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae20aa-79a8-47c1-a2da-be17e288ef4b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:26.643966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 631/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Fri May 13 17:11:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:26.649685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4f34-5c68-4302-a234-af64ca149524 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:26.744875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4f34-5c68-4302-a234-af64ca149524 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:26.777204 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9741f8-b750-4457-8afa-70b10280f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:26.777840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9741f8-b750-4457-8afa-70b10280f560 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:26.778119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9741f8-b750-4457-8afa-70b10280f560 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:26.778479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9741f8-b750-4457-8afa-70b10280f560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:26.842560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9741f8-b750-4457-8afa-70b10280f560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:26.844056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9741f8-b750-4457-8afa-70b10280f560 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:26.944054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 624/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:11:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:11:26.949980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae20aa-79a8-47c1-a2da-be17e288ef4b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:27.043762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae20aa-79a8-47c1-a2da-be17e288ef4b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:27.076285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5905bb-fafa-4eec-8f00-626622c0b712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:27.077325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5905bb-fafa-4eec-8f00-626622c0b712 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:27.077606 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5905bb-fafa-4eec-8f00-626622c0b712 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:27.077877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5905bb-fafa-4eec-8f00-626622c0b712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:27.087684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5905bb-fafa-4eec-8f00-626622c0b712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:27.089136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5905bb-fafa-4eec-8f00-626622c0b712 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-0b5905bb-fafa-4eec-8f00-626622c0b712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:27.106472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:27.107403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:27.108344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:27.108344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:27.108344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:27.108344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:27.108344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 632/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:27.114307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9741f8-b750-4457-8afa-70b10280f560 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:27.216468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9741f8-b750-4457-8afa-70b10280f560 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:27.249509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a847b-ed44-45ba-9080-f724e75b4f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:27.250165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a847b-ed44-45ba-9080-f724e75b4f69 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:27.250448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a847b-ed44-45ba-9080-f724e75b4f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:27.250721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a847b-ed44-45ba-9080-f724e75b4f69 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:27.252010 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a847b-ed44-45ba-9080-f724e75b4f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:27.254884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a847b-ed44-45ba-9080-f724e75b4f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:27.254884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a847b-ed44-45ba-9080-f724e75b4f69 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:27.264433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 625/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:27.270156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5905bb-fafa-4eec-8f00-626622c0b712 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:27.364280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5905bb-fafa-4eec-8f00-626622c0b712 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:27.396568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43614ad-d0dc-42c9-96b8-2c9332d356b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:27.397348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43614ad-d0dc-42c9-96b8-2c9332d356b0 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:27.397630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43614ad-d0dc-42c9-96b8-2c9332d356b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:27.397906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43614ad-d0dc-42c9-96b8-2c9332d356b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:27.404316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43614ad-d0dc-42c9-96b8-2c9332d356b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:27.405764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43614ad-d0dc-42c9-96b8-2c9332d356b0 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-b43614ad-d0dc-42c9-96b8-2c9332d356b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:11:27.419276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:27.420328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:27.421533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:11:27.421533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:11:27.421533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:11:27.421533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:11:27.421533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:11:27.421533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:11:27.421533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:27.421533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:27.421533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 633/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:27.426914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a847b-ed44-45ba-9080-f724e75b4f69 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:27.522749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a847b-ed44-45ba-9080-f724e75b4f69 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:27.555439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197e800-b1e8-4819-8f81-bd021892a6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:27.556097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197e800-b1e8-4819-8f81-bd021892a6ed None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:27.556382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197e800-b1e8-4819-8f81-bd021892a6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:27.556658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197e800-b1e8-4819-8f81-bd021892a6ed None admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:27.557438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197e800-b1e8-4819-8f81-bd021892a6ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:27.557746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197e800-b1e8-4819-8f81-bd021892a6ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:27.559273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197e800-b1e8-4819-8f81-bd021892a6ed None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:27.570761 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 626/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:27.577206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43614ad-d0dc-42c9-96b8-2c9332d356b0 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:27.672394 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43614ad-d0dc-42c9-96b8-2c9332d356b0 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:27.704176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ae68a-9a42-4903-9c7c-5a30b3e35d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:27.704839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ae68a-9a42-4903-9c7c-5a30b3e35d46 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:27.705122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ae68a-9a42-4903-9c7c-5a30b3e35d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:27.705397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ae68a-9a42-4903-9c7c-5a30b3e35d46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:27.706216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ae68a-9a42-4903-9c7c-5a30b3e35d46 None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=b84ae21424694df68a96b928e15e9240) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:27.706524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ae68a-9a42-4903-9c7c-5a30b3e35d46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:27.707993 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ae68a-9a42-4903-9c7c-5a30b3e35d46 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:27.713407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 634/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:11:27 2022] GET /identity/v3/role_assignments?user.id=b84ae21424694df68a96b928e15e9240&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=2791519d9bad43318f086666b6e64a20 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:29.898793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bc280-148e-4c3f-8c9e-4d1efc449899 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:29.899366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bc280-148e-4c3f-8c9e-4d1efc449899 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:29.899366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bc280-148e-4c3f-8c9e-4d1efc449899 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:29.900842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 627/1261] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:11:29.905928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd56f-f212-4401-99a3-ec6054a94172 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:29.906362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd56f-f212-4401-99a3-ec6054a94172 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:29.906529 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd56f-f212-4401-99a3-ec6054a94172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:29.923889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-fb9fd56f-f212-4401-99a3-ec6054a94172 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:11:29.925068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fb9fd56f-f212-4401-99a3-ec6054a94172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:11:29.991798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 635/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:11:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:11:30.013615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bc280-148e-4c3f-8c9e-4d1efc449899 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:30.112050 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bc280-148e-4c3f-8c9e-4d1efc449899 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:30.144521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a8cf-859d-4e07-a116-44e2ffeea920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:30.145293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a8cf-859d-4e07-a116-44e2ffeea920 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:30.145568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a8cf-859d-4e07-a116-44e2ffeea920 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:30.145835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a8cf-859d-4e07-a116-44e2ffeea920 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:30.155475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a8cf-859d-4e07-a116-44e2ffeea920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-a3b8a8cf-859d-4e07-a116-44e2ffeea920 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:11:30.163522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:30.166510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:30.167478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 628/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:11:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:30.170610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fd56f-f212-4401-99a3-ec6054a94172 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:30.265565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fd56f-f212-4401-99a3-ec6054a94172 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:30.298130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08cd4d-481b-4874-9c93-5b714bf9331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:30.298822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08cd4d-481b-4874-9c93-5b714bf9331a None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:30.299103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08cd4d-481b-4874-9c93-5b714bf9331a None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:30.299407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08cd4d-481b-4874-9c93-5b714bf9331a None admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:30.300151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08cd4d-481b-4874-9c93-5b714bf9331a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:30.300454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08cd4d-481b-4874-9c93-5b714bf9331a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:30.301829 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08cd4d-481b-4874-9c93-5b714bf9331a None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:30.309692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 636/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:11:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:30.315346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a8cf-859d-4e07-a116-44e2ffeea920 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:30.412526 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a8cf-859d-4e07-a116-44e2ffeea920 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:30.443673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bbcf6-229b-47c2-b203-ed63184764b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:30.444487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bbcf6-229b-47c2-b203-ed63184764b9 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:30.444772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bbcf6-229b-47c2-b203-ed63184764b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:30.445048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bbcf6-229b-47c2-b203-ed63184764b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:30.456870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bbcf6-229b-47c2-b203-ed63184764b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:30.458357 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bbcf6-229b-47c2-b203-ed63184764b9 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-ac5bbcf6-229b-47c2-b203-ed63184764b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:30.476066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:30.477132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:30.478470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:30.478470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:30.478470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:30.478470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:30.478470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 629/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:30.483254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08cd4d-481b-4874-9c93-5b714bf9331a None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:30.580786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08cd4d-481b-4874-9c93-5b714bf9331a None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:30.612808 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65efa96-2e30-4e7a-ab07-630c11d14608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:30.613450 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65efa96-2e30-4e7a-ab07-630c11d14608 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:30.613733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65efa96-2e30-4e7a-ab07-630c11d14608 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:30.614010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65efa96-2e30-4e7a-ab07-630c11d14608 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:30.614725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65efa96-2e30-4e7a-ab07-630c11d14608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:30.615030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65efa96-2e30-4e7a-ab07-630c11d14608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:30.616436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65efa96-2e30-4e7a-ab07-630c11d14608 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:30.627605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 637/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:30.633230 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bbcf6-229b-47c2-b203-ed63184764b9 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:30.728750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bbcf6-229b-47c2-b203-ed63184764b9 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:30.760611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e056-877c-4820-bd0f-252b6dec651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:30.761430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e056-877c-4820-bd0f-252b6dec651a None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:30.761736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e056-877c-4820-bd0f-252b6dec651a None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:30.766725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e056-877c-4820-bd0f-252b6dec651a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:30.769280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725e056-877c-4820-bd0f-252b6dec651a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:30.770733 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725e056-877c-4820-bd0f-252b6dec651a None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-a725e056-877c-4820-bd0f-252b6dec651a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:11:30.785055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:30.786027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:30.786969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:30.786969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:30.786969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:11:30.786969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:11:30.786969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:11:30.786969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:11:30.786969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:11:30.786969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:11:30.786969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:30.786969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:30.786969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 630/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:30.792034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65efa96-2e30-4e7a-ab07-630c11d14608 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:30.895995 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65efa96-2e30-4e7a-ab07-630c11d14608 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:30.929167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b0f3f-a4cd-4f5e-b33b-89b3daa55622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:30.929831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0f3f-a4cd-4f5e-b33b-89b3daa55622 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:30.930113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0f3f-a4cd-4f5e-b33b-89b3daa55622 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:30.930401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0f3f-a4cd-4f5e-b33b-89b3daa55622 None admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:30.931263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b0f3f-a4cd-4f5e-b33b-89b3daa55622 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:30.931570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b0f3f-a4cd-4f5e-b33b-89b3daa55622 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:30.933043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b0f3f-a4cd-4f5e-b33b-89b3daa55622 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:30.949624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 638/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Fri May 13 17:11:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:30.956110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e056-877c-4820-bd0f-252b6dec651a None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:31.051278 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e056-877c-4820-bd0f-252b6dec651a None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:31.083287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96706534-464f-4317-bf4e-ec940e106e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:31.084111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96706534-464f-4317-bf4e-ec940e106e77 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:31.084394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96706534-464f-4317-bf4e-ec940e106e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:31.084668 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96706534-464f-4317-bf4e-ec940e106e77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:31.095444 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96706534-464f-4317-bf4e-ec940e106e77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:31.096942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96706534-464f-4317-bf4e-ec940e106e77 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-96706534-464f-4317-bf4e-ec940e106e77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:31.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:31.114158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:31.115147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:31.115147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:31.115147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:31.115147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:31.115147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 631/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:31.120071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b0f3f-a4cd-4f5e-b33b-89b3daa55622 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:31.224970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b0f3f-a4cd-4f5e-b33b-89b3daa55622 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:31.257119 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509363be-da9e-4cb7-acfa-42caa8fafd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:31.257713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509363be-da9e-4cb7-acfa-42caa8fafd2f None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:31.258000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509363be-da9e-4cb7-acfa-42caa8fafd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:31.258275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509363be-da9e-4cb7-acfa-42caa8fafd2f None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:31.258988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509363be-da9e-4cb7-acfa-42caa8fafd2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:31.259325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509363be-da9e-4cb7-acfa-42caa8fafd2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:31.260700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509363be-da9e-4cb7-acfa-42caa8fafd2f None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:31.272218 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 639/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:31.277892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96706534-464f-4317-bf4e-ec940e106e77 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:31.372914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96706534-464f-4317-bf4e-ec940e106e77 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:31.404688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bdbc4-6100-46d5-91a7-63b5dc61c5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:31.405466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bdbc4-6100-46d5-91a7-63b5dc61c5fd None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:31.405743 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bdbc4-6100-46d5-91a7-63b5dc61c5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:31.406013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bdbc4-6100-46d5-91a7-63b5dc61c5fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:31.412434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bdbc4-6100-46d5-91a7-63b5dc61c5fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:31.413906 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bdbc4-6100-46d5-91a7-63b5dc61c5fd None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-8d3bdbc4-6100-46d5-91a7-63b5dc61c5fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:11:31.427525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:31.428569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:31.429714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:11:31.429714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:11:31.429714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:11:31.429714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:11:31.429714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:11:31.429714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:11:31.429714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:31.429714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:31.429714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 632/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:31.434562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509363be-da9e-4cb7-acfa-42caa8fafd2f None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:31.531273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509363be-da9e-4cb7-acfa-42caa8fafd2f None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:31.563299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b3b5c-0132-4ab4-9646-b45c5b705f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:31.564487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b3b5c-0132-4ab4-9646-b45c5b705f97 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:31.564770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b3b5c-0132-4ab4-9646-b45c5b705f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:31.565045 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b3b5c-0132-4ab4-9646-b45c5b705f97 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:31.565822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b3b5c-0132-4ab4-9646-b45c5b705f97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:31.566129 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b3b5c-0132-4ab4-9646-b45c5b705f97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:31.567670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b3b5c-0132-4ab4-9646-b45c5b705f97 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:31.580726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 640/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:11:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:11:31.586565 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bdbc4-6100-46d5-91a7-63b5dc61c5fd None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:31.681167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bdbc4-6100-46d5-91a7-63b5dc61c5fd None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:31.713377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f781d4-e016-49f6-a10c-674ede62b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:31.714235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f781d4-e016-49f6-a10c-674ede62b6d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:31.714510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f781d4-e016-49f6-a10c-674ede62b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:31.714776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f781d4-e016-49f6-a10c-674ede62b6d1 None admin] PATH_INFO: `/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/b84ae21424694df68a96b928e15e9240/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:31.716733 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f781d4-e016-49f6-a10c-674ede62b6d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d1800939cad4368b4eafe8b6dfe12c3, user_id=b84ae21424694df68a96b928e15e9240, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:31.718231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f781d4-e016-49f6-a10c-674ede62b6d1 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:31.790727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 633/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Fri May 13 17:11:31 2022] PUT /identity/v3/projects/0d1800939cad4368b4eafe8b6dfe12c3/users/b84ae21424694df68a96b928e15e9240/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:11:33.982668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935123-5dbf-4ee8-a141-9c72938fcfb4 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:33.983272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935123-5dbf-4ee8-a141-9c72938fcfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:33.983272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935123-5dbf-4ee8-a141-9c72938fcfb4 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:33.984778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 641/1274] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:11:33.990425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b56c80-8b51-4025-84c9-10faa95fdd12 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:33.990944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b56c80-8b51-4025-84c9-10faa95fdd12 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:33.991020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b56c80-8b51-4025-84c9-10faa95fdd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:34.009522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-67b56c80-8b51-4025-84c9-10faa95fdd12 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:11:34.010762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-67b56c80-8b51-4025-84c9-10faa95fdd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:11:34.081510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 634/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:11:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:11:34.105591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a935123-5dbf-4ee8-a141-9c72938fcfb4 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:34.214034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a935123-5dbf-4ee8-a141-9c72938fcfb4 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:34.248563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78e252-9c8b-4894-b204-791f2db28c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:34.249283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e252-9c8b-4894-b204-791f2db28c67 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:34.249614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e252-9c8b-4894-b204-791f2db28c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:34.249982 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e252-9c8b-4894-b204-791f2db28c67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:34.262322 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78e252-9c8b-4894-b204-791f2db28c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-ce78e252-9c8b-4894-b204-791f2db28c67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 17:11:34.270364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:34.277515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:34.278563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 642/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Fri May 13 17:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:34.280634 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b56c80-8b51-4025-84c9-10faa95fdd12 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:34.379628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b56c80-8b51-4025-84c9-10faa95fdd12 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:34.413037 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5074f1-bcdf-4aa0-ad53-956e83c173c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:34.413674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5074f1-bcdf-4aa0-ad53-956e83c173c0 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:34.413958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5074f1-bcdf-4aa0-ad53-956e83c173c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:34.414233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5074f1-bcdf-4aa0-ad53-956e83c173c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:34.414980 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5074f1-bcdf-4aa0-ad53-956e83c173c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:34.415318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5074f1-bcdf-4aa0-ad53-956e83c173c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:34.416760 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5074f1-bcdf-4aa0-ad53-956e83c173c0 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:34.425512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 635/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Fri May 13 17:11:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:34.431488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78e252-9c8b-4894-b204-791f2db28c67 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:34.530259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78e252-9c8b-4894-b204-791f2db28c67 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:34.563064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef267b8-7fac-4bd4-af7c-17e465249b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:34.563908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef267b8-7fac-4bd4-af7c-17e465249b8b None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:34.564193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef267b8-7fac-4bd4-af7c-17e465249b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:34.564469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef267b8-7fac-4bd4-af7c-17e465249b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:34.574499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef267b8-7fac-4bd4-af7c-17e465249b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:34.576030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef267b8-7fac-4bd4-af7c-17e465249b8b None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-7ef267b8-7fac-4bd4-af7c-17e465249b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:34.592733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:34.593817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:34.595434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:34.595434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:34.595434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:34.595434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:34.595434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 643/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 17:11:34.600286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5074f1-bcdf-4aa0-ad53-956e83c173c0 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:34.696203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5074f1-bcdf-4aa0-ad53-956e83c173c0 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:34.729207 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c72a1-4dff-4dcc-89c3-76a04377a011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:34.729861 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c72a1-4dff-4dcc-89c3-76a04377a011 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:34.730146 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c72a1-4dff-4dcc-89c3-76a04377a011 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:34.730423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c72a1-4dff-4dcc-89c3-76a04377a011 None admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:34.731153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c72a1-4dff-4dcc-89c3-76a04377a011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:34.731472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c72a1-4dff-4dcc-89c3-76a04377a011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:34.732867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c72a1-4dff-4dcc-89c3-76a04377a011 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:34.744241 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 636/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:34.749879 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef267b8-7fac-4bd4-af7c-17e465249b8b None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:34.846083 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef267b8-7fac-4bd4-af7c-17e465249b8b None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:34.877203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d34cd-2e1f-4e38-a2ac-397582a4efcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:34.878357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d34cd-2e1f-4e38-a2ac-397582a4efcf None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:34.878357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d34cd-2e1f-4e38-a2ac-397582a4efcf None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:34.878531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d34cd-2e1f-4e38-a2ac-397582a4efcf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:34.885651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d34cd-2e1f-4e38-a2ac-397582a4efcf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:34.887172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d34cd-2e1f-4e38-a2ac-397582a4efcf None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-b28d34cd-2e1f-4e38-a2ac-397582a4efcf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 17:11:34.901610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:34.902708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:34.903901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:34.903901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:34.903901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 17:11:34.903901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 17:11:34.903901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 17:11:34.903901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 17:11:34.903901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 17:11:34.903901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 17:11:34.903901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 17:11:34.903901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:34.903901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 644/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:34.909197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c72a1-4dff-4dcc-89c3-76a04377a011 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:35.005620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c72a1-4dff-4dcc-89c3-76a04377a011 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:35.038571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b9251-d8e9-4bd3-8103-e182cb7c6833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:35.039257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9251-d8e9-4bd3-8103-e182cb7c6833 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:35.039537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9251-d8e9-4bd3-8103-e182cb7c6833 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:35.039805 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9251-d8e9-4bd3-8103-e182cb7c6833 None admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:35.040673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b9251-d8e9-4bd3-8103-e182cb7c6833 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:35.040970 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b9251-d8e9-4bd3-8103-e182cb7c6833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:35.042400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b9251-d8e9-4bd3-8103-e182cb7c6833 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:35.058974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 637/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Fri May 13 17:11:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:35.065319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d34cd-2e1f-4e38-a2ac-397582a4efcf None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:35.160244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d34cd-2e1f-4e38-a2ac-397582a4efcf None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:35.191850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1089e-b931-45b6-baa8-12dbde4a2359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:35.192505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1089e-b931-45b6-baa8-12dbde4a2359 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:35.192769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1089e-b931-45b6-baa8-12dbde4a2359 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:35.193045 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1089e-b931-45b6-baa8-12dbde4a2359 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:35.263860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1089e-b931-45b6-baa8-12dbde4a2359 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:35.265346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1089e-b931-45b6-baa8-12dbde4a2359 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:35.361190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 645/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Fri May 13 17:11:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 17:11:35.367003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b9251-d8e9-4bd3-8103-e182cb7c6833 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:35.461420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b9251-d8e9-4bd3-8103-e182cb7c6833 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:35.494276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486947b-b727-45a3-a9c3-29d160183a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:35.495053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486947b-b727-45a3-a9c3-29d160183a07 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:35.495364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486947b-b727-45a3-a9c3-29d160183a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:35.495640 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486947b-b727-45a3-a9c3-29d160183a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:35.505449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486947b-b727-45a3-a9c3-29d160183a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:35.506912 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486947b-b727-45a3-a9c3-29d160183a07 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-e486947b-b727-45a3-a9c3-29d160183a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 17:11:35.525226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:35.526154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:35.527107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 17:11:35.527107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 17:11:35.527107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 17:11:35.527107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:35.527107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 638/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:35.532186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1089e-b931-45b6-baa8-12dbde4a2359 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:35.625609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1089e-b931-45b6-baa8-12dbde4a2359 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:35.658129 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556bc59-13c6-4b69-a411-96e4a3136ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:35.658777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556bc59-13c6-4b69-a411-96e4a3136ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:35.659056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556bc59-13c6-4b69-a411-96e4a3136ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:35.659358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556bc59-13c6-4b69-a411-96e4a3136ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:35.660057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556bc59-13c6-4b69-a411-96e4a3136ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:35.660356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556bc59-13c6-4b69-a411-96e4a3136ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:35.661721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556bc59-13c6-4b69-a411-96e4a3136ea6 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:35.672293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 646/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Fri May 13 17:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:35.677919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486947b-b727-45a3-a9c3-29d160183a07 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:35.774288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486947b-b727-45a3-a9c3-29d160183a07 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:35.807048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacc656-f0e8-4d0e-ab3a-8bea4aacc4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:35.807869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc656-f0e8-4d0e-ab3a-8bea4aacc4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:35.808152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc656-f0e8-4d0e-ab3a-8bea4aacc4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:35.808428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc656-f0e8-4d0e-ab3a-8bea4aacc4b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:35.815736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacc656-f0e8-4d0e-ab3a-8bea4aacc4b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:35.817193 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacc656-f0e8-4d0e-ab3a-8bea4aacc4b7 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application [None req-9dacc656-f0e8-4d0e-ab3a-8bea4aacc4b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 17:11:35.831563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application with Lock( May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:35.832631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:35.833866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 17:11:35.833866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 17:11:35.833866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 17:11:35.833866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 17:11:35.833866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 17:11:35.833866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 17:11:35.833866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 17:11:35.833866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: ERROR keystone.server.flask.application May 13 17:11:35.833866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 639/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Fri May 13 17:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:35.838654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556bc59-13c6-4b69-a411-96e4a3136ea6 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:35.932368 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556bc59-13c6-4b69-a411-96e4a3136ea6 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:35.964930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1dec3-cf44-41be-ae91-130aebea78a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:35.965588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1dec3-cf44-41be-ae91-130aebea78a8 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:35.965875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1dec3-cf44-41be-ae91-130aebea78a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:35.966156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1dec3-cf44-41be-ae91-130aebea78a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:35.966945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1dec3-cf44-41be-ae91-130aebea78a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:35.967294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1dec3-cf44-41be-ae91-130aebea78a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:35.968741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1dec3-cf44-41be-ae91-130aebea78a8 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:35.980422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 647/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Fri May 13 17:11:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:35.986365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacc656-f0e8-4d0e-ab3a-8bea4aacc4b7 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:36.082259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacc656-f0e8-4d0e-ab3a-8bea4aacc4b7 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:36.113116 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b6a9d-d2b9-47b3-9d5a-747b5d7a6f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:36.113754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b6a9d-d2b9-47b3-9d5a-747b5d7a6f6e None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:36.114035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b6a9d-d2b9-47b3-9d5a-747b5d7a6f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:36.114307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b6a9d-d2b9-47b3-9d5a-747b5d7a6f6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:36.115157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b6a9d-d2b9-47b3-9d5a-747b5d7a6f6e None admin] RBAC: Adding query filter params (role.id=2791519d9bad43318f086666b6e64a20, scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3, user.id=b84ae21424694df68a96b928e15e9240) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:36.115461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b6a9d-d2b9-47b3-9d5a-747b5d7a6f6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:36.116911 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b6a9d-d2b9-47b3-9d5a-747b5d7a6f6e None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:36.123237 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 640/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Fri May 13 17:11:35 2022] GET /identity/v3/role_assignments?user.id=b84ae21424694df68a96b928e15e9240&scope.project.id=0d1800939cad4368b4eafe8b6dfe12c3&role.id=2791519d9bad43318f086666b6e64a20 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:38.347572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cb05-81f2-41f9-8753-338eade915f9 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:38.348089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cb05-81f2-41f9-8753-338eade915f9 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:38.348089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cb05-81f2-41f9-8753-338eade915f9 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:38.349479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 648/1288] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:11:38.354723 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f3b58-3003-415c-afd5-794953a1a433 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:38.355183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f3b58-3003-415c-afd5-794953a1a433 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:38.355335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f3b58-3003-415c-afd5-794953a1a433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:38.372182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d28f3b58-3003-415c-afd5-794953a1a433 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:11:38.373366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d28f3b58-3003-415c-afd5-794953a1a433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:11:38.437394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 641/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:11:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:11:38.460388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229cb05-81f2-41f9-8753-338eade915f9 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:38.558757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229cb05-81f2-41f9-8753-338eade915f9 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:38.591276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350148ca-9529-49e9-ba0d-6a1dc9bc2d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:38.592057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350148ca-9529-49e9-ba0d-6a1dc9bc2d77 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:38.592345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350148ca-9529-49e9-ba0d-6a1dc9bc2d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:38.592621 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350148ca-9529-49e9-ba0d-6a1dc9bc2d77 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:38.593271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350148ca-9529-49e9-ba0d-6a1dc9bc2d77 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:38.595330 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350148ca-9529-49e9-ba0d-6a1dc9bc2d77 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-350148ca-9529-49e9-ba0d-6a1dc9bc2d77 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:38.607038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:38.608346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:38.609487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 649/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Fri May 13 17:11:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:38.614507 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f3b58-3003-415c-afd5-794953a1a433 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:38.709304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f3b58-3003-415c-afd5-794953a1a433 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:38.741241 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a8e36-353d-4132-a880-537fc577d055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:38.741891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8e36-353d-4132-a880-537fc577d055 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:38.742173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8e36-353d-4132-a880-537fc577d055 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:38.742445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8e36-353d-4132-a880-537fc577d055 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:38.743162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a8e36-353d-4132-a880-537fc577d055 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:38.743464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a8e36-353d-4132-a880-537fc577d055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:38.744850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a8e36-353d-4132-a880-537fc577d055 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:38.749460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 642/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Fri May 13 17:11:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:38.755289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350148ca-9529-49e9-ba0d-6a1dc9bc2d77 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:38.852801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350148ca-9529-49e9-ba0d-6a1dc9bc2d77 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:38.893121 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde81b4a-20a7-4193-af3d-5c873c0c00e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:38.893790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde81b4a-20a7-4193-af3d-5c873c0c00e3 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:38.894076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde81b4a-20a7-4193-af3d-5c873c0c00e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:38.894352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde81b4a-20a7-4193-af3d-5c873c0c00e3 None admin] PATH_INFO: `/v3/services` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:38.895056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde81b4a-20a7-4193-af3d-5c873c0c00e3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:38.895391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde81b4a-20a7-4193-af3d-5c873c0c00e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:38.896931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde81b4a-20a7-4193-af3d-5c873c0c00e3 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:38.901338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 650/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Fri May 13 17:11:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:41.095988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345efc6-e703-458e-83e8-168357136d33 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:41.096532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345efc6-e703-458e-83e8-168357136d33 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:41.096532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345efc6-e703-458e-83e8-168357136d33 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:41.097900 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 643/1293] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:11:41.103167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f5220-0299-4de1-b6e0-bf3449d52674 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:41.110983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f5220-0299-4de1-b6e0-bf3449d52674 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:41.110983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f5220-0299-4de1-b6e0-bf3449d52674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:41.120579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-ad8f5220-0299-4de1-b6e0-bf3449d52674 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:11:41.121757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ad8f5220-0299-4de1-b6e0-bf3449d52674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:11:41.184792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 651/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:11:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:11:41.206905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345efc6-e703-458e-83e8-168357136d33 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:41.306051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345efc6-e703-458e-83e8-168357136d33 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:41.338501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37deb7-7c6e-493f-b7b2-f2380856a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:41.339164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37deb7-7c6e-493f-b7b2-f2380856a607 None admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:41.339450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37deb7-7c6e-493f-b7b2-f2380856a607 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:41.339721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37deb7-7c6e-493f-b7b2-f2380856a607 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:41.340441 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37deb7-7c6e-493f-b7b2-f2380856a607 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:41.341856 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37deb7-7c6e-493f-b7b2-f2380856a607 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:41.447745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 644/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Fri May 13 17:11:41 2022] POST /identity/v3/services => generated 246 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:11:43.645081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186effb7-825f-4c0e-827c-efb1dab05d8f None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:43.645648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186effb7-825f-4c0e-827c-efb1dab05d8f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:43.645648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186effb7-825f-4c0e-827c-efb1dab05d8f None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:43.647070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 652/1296] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:11:43.652284 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5924-151d-431f-beb3-d782b2717de6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:43.654905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5924-151d-431f-beb3-d782b2717de6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:43.654905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5924-151d-431f-beb3-d782b2717de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:43.668968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a86e5924-151d-431f-beb3-d782b2717de6 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:11:43.670184 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a86e5924-151d-431f-beb3-d782b2717de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:11:43.741554 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 645/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:11:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:11:43.764572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186effb7-825f-4c0e-827c-efb1dab05d8f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:43.861249 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186effb7-825f-4c0e-827c-efb1dab05d8f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:43.893145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45768a9-103c-4c2b-b48e-e7f9f19cc236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:43.893923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45768a9-103c-4c2b-b48e-e7f9f19cc236 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:43.894202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45768a9-103c-4c2b-b48e-e7f9f19cc236 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:43.894479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45768a9-103c-4c2b-b48e-e7f9f19cc236 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:43.895193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45768a9-103c-4c2b-b48e-e7f9f19cc236 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:43.896574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45768a9-103c-4c2b-b48e-e7f9f19cc236 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-c45768a9-103c-4c2b-b48e-e7f9f19cc236 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:43.908064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:43.909086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:43.910168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 653/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Fri May 13 17:11:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:43.915611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5924-151d-431f-beb3-d782b2717de6 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:44.010842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5924-151d-431f-beb3-d782b2717de6 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:44.043154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168e702-00db-4c6f-8e2c-66fb4a2f5215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:44.043844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168e702-00db-4c6f-8e2c-66fb4a2f5215 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:44.044107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168e702-00db-4c6f-8e2c-66fb4a2f5215 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:44.044383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168e702-00db-4c6f-8e2c-66fb4a2f5215 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:44.045076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168e702-00db-4c6f-8e2c-66fb4a2f5215 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:44.045379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168e702-00db-4c6f-8e2c-66fb4a2f5215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:44.046796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168e702-00db-4c6f-8e2c-66fb4a2f5215 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:44.052307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 646/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Fri May 13 17:11:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:44.058181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45768a9-103c-4c2b-b48e-e7f9f19cc236 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:44.152146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45768a9-103c-4c2b-b48e-e7f9f19cc236 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:44.183892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f79c8e-0e1d-4cb9-ad1c-037f1ef0ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:44.184531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f79c8e-0e1d-4cb9-ad1c-037f1ef0ce41 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:44.184821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f79c8e-0e1d-4cb9-ad1c-037f1ef0ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:44.185090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f79c8e-0e1d-4cb9-ad1c-037f1ef0ce41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:44.185859 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f79c8e-0e1d-4cb9-ad1c-037f1ef0ce41 None admin] RBAC: Adding query filter params (interface=public, service_id=c44341b959f14ad79626fa374841e999, region_id=RegionOne) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:44.186165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f79c8e-0e1d-4cb9-ad1c-037f1ef0ce41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:44.187565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f79c8e-0e1d-4cb9-ad1c-037f1ef0ce41 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:44.192455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 654/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Fri May 13 17:11:44 2022] GET /identity/v3/endpoints?service_id=c44341b959f14ad79626fa374841e999&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:44.198031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168e702-00db-4c6f-8e2c-66fb4a2f5215 None admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:44.292387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168e702-00db-4c6f-8e2c-66fb4a2f5215 None admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:44.324549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773aac40-ce8e-45e2-a881-7b6b0079135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:44.325201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773aac40-ce8e-45e2-a881-7b6b0079135d None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:44.325485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773aac40-ce8e-45e2-a881-7b6b0079135d None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:44.325759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773aac40-ce8e-45e2-a881-7b6b0079135d None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:44.326429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773aac40-ce8e-45e2-a881-7b6b0079135d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:44.328112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773aac40-ce8e-45e2-a881-7b6b0079135d None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:44.334597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 647/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Fri May 13 17:11:44 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:11:46.515379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a21f5-b6ce-49ef-a264-3b5a59e8cdbc None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:46.515905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a21f5-b6ce-49ef-a264-3b5a59e8cdbc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:46.515905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a21f5-b6ce-49ef-a264-3b5a59e8cdbc None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:46.517319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 655/1302] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:11:46.522415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339736c-d835-439c-9396-1dfbe5c6f2da None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:46.522913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339736c-d835-439c-9396-1dfbe5c6f2da None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:46.523010 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339736c-d835-439c-9396-1dfbe5c6f2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:46.539871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e339736c-d835-439c-9396-1dfbe5c6f2da None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:11:46.541044 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e339736c-d835-439c-9396-1dfbe5c6f2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:11:46.607389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 648/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:11:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 17:11:46.630585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a21f5-b6ce-49ef-a264-3b5a59e8cdbc None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:46.732109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a21f5-b6ce-49ef-a264-3b5a59e8cdbc None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:46.764132 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dd2d8-ae03-4386-ab22-a079806b3754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:46.764921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dd2d8-ae03-4386-ab22-a079806b3754 None admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:46.765206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dd2d8-ae03-4386-ab22-a079806b3754 None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:46.765523 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dd2d8-ae03-4386-ab22-a079806b3754 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:46.766126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dd2d8-ae03-4386-ab22-a079806b3754 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:46.768177 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dd2d8-ae03-4386-ab22-a079806b3754 None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application [None req-6b7dd2d8-ae03-4386-ab22-a079806b3754 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 17:11:46.780012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 17:11:46.842053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.get_or_create( May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application with Lock( May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self._enter() May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application return self.creator() May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application created_value = creator( May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: ERROR keystone.server.flask.application May 13 17:11:46.843209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 656/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Fri May 13 17:11:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 17:11:46.844261 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339736c-d835-439c-9396-1dfbe5c6f2da None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:46.884602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339736c-d835-439c-9396-1dfbe5c6f2da None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:46.917891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa961c-c11e-490b-818b-ec0eb6d4db32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:46.918547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa961c-c11e-490b-818b-ec0eb6d4db32 None admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:46.918825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa961c-c11e-490b-818b-ec0eb6d4db32 None admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:46.919097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa961c-c11e-490b-818b-ec0eb6d4db32 None admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:46.919826 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa961c-c11e-490b-818b-ec0eb6d4db32 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:11:46.920130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa961c-c11e-490b-818b-ec0eb6d4db32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:46.921608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa961c-c11e-490b-818b-ec0eb6d4db32 None admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:46.926570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 649/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Fri May 13 17:11:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:11:46.932385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dd2d8-ae03-4386-ab22-a079806b3754 None admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:11:47.030323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dd2d8-ae03-4386-ab22-a079806b3754 None admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:11:47.062618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3116f7-f3a6-475c-bf2f-5bea4bef5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:11:47.063792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3116f7-f3a6-475c-bf2f-5bea4bef5bec None admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:11:47.064080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3116f7-f3a6-475c-bf2f-5bea4bef5bec None admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:11:47.064359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3116f7-f3a6-475c-bf2f-5bea4bef5bec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:11:47.065103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3116f7-f3a6-475c-bf2f-5bea4bef5bec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:11:47.066498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3116f7-f3a6-475c-bf2f-5bea4bef5bec None admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:11:47.168096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 657/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Fri May 13 17:11:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:18:01.607524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392f34-a725-48cb-9f2c-e281b1d44cda None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:01.608042 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392f34-a725-48cb-9f2c-e281b1d44cda None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:01.608303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392f34-a725-48cb-9f2c-e281b1d44cda None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:01.610155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 650/1307] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:18:01.615342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d43a3-538a-46b7-8436-ca61c3b62171 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:01.615735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d43a3-538a-46b7-8436-ca61c3b62171 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:01.615973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d43a3-538a-46b7-8436-ca61c3b62171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:01.708507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-703d43a3-538a-46b7-8436-ca61c3b62171 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:01.709999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-703d43a3-538a-46b7-8436-ca61c3b62171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:01.817293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 658/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:18:01.873410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0357f20-f1b6-4a9c-84d7-650647e8f733 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:01.873797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0357f20-f1b6-4a9c-84d7-650647e8f733 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:01.874155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0357f20-f1b6-4a9c-84d7-650647e8f733 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:01.875851 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 651/1309] 10.222.0.64 () {54 vars in 964 bytes} [Fri May 13 17:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:01.881944 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84547f37-8310-48ec-b7d2-8d9cdadcd58a None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:01.882238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84547f37-8310-48ec-b7d2-8d9cdadcd58a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:01.882582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84547f37-8310-48ec-b7d2-8d9cdadcd58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:01.964947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-84547f37-8310-48ec-b7d2-8d9cdadcd58a None None] MFA Rules not processed for user `d99855838f77462886cc87db440e1037`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:01.966470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-84547f37-8310-48ec-b7d2-8d9cdadcd58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:02.054553 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 659/1310] 10.222.0.64 () {58 vars in 1061 bytes} [Fri May 13 17:18:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:02.064192 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0357f20-f1b6-4a9c-84d7-650647e8f733 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:02.066284 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d0357f20-f1b6-4a9c-84d7-650647e8f733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:02.173921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0357f20-f1b6-4a9c-84d7-650647e8f733 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:02.248734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80d620-f26d-4830-93be-9b8eea113607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:02.249384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80d620-f26d-4830-93be-9b8eea113607 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:02.249659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80d620-f26d-4830-93be-9b8eea113607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:02.249929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80d620-f26d-4830-93be-9b8eea113607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:02.251599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5e80d620-f26d-4830-93be-9b8eea113607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:02.362666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80d620-f26d-4830-93be-9b8eea113607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:02.364172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80d620-f26d-4830-93be-9b8eea113607 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:02.381974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 652/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:18:04.914297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c50b01-d9d8-4547-96cb-b67436a3ffb2 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:04.914890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c50b01-d9d8-4547-96cb-b67436a3ffb2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:04.914890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c50b01-d9d8-4547-96cb-b67436a3ffb2 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:04.916293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 660/1312] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:04.921598 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c6fca-96db-41ac-b30f-5ee0fed85ecd None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:04.921983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c6fca-96db-41ac-b30f-5ee0fed85ecd None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:04.922162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c6fca-96db-41ac-b30f-5ee0fed85ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:04.997408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-642c6fca-96db-41ac-b30f-5ee0fed85ecd None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:04.998637 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-642c6fca-96db-41ac-b30f-5ee0fed85ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:05.096067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 653/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:05.149835 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76746b-6d0a-47ca-acb6-3f8817ad82e2 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:05.150270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76746b-6d0a-47ca-acb6-3f8817ad82e2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:05.150656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76746b-6d0a-47ca-acb6-3f8817ad82e2 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:05.152240 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 661/1314] 10.222.0.64 () {54 vars in 964 bytes} [Fri May 13 17:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:05.158484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc839213-530b-4af7-bff7-d48999723b36 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:05.158894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc839213-530b-4af7-bff7-d48999723b36 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:05.159305 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc839213-530b-4af7-bff7-d48999723b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:05.233568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-bc839213-530b-4af7-bff7-d48999723b36 None None] MFA Rules not processed for user `d99855838f77462886cc87db440e1037`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:05.234929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bc839213-530b-4af7-bff7-d48999723b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:05.313543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 654/1315] 10.222.0.64 () {58 vars in 1061 bytes} [Fri May 13 17:18:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:05.323543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76746b-6d0a-47ca-acb6-3f8817ad82e2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:05.325145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-bb76746b-6d0a-47ca-acb6-3f8817ad82e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:05.430444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76746b-6d0a-47ca-acb6-3f8817ad82e2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:05.505497 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a09c5-1a5a-4f20-b71b-1c4c5c6625a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:05.506171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a09c5-1a5a-4f20-b71b-1c4c5c6625a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:05.506443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a09c5-1a5a-4f20-b71b-1c4c5c6625a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:05.506718 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a09c5-1a5a-4f20-b71b-1c4c5c6625a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:05.508413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-015a09c5-1a5a-4f20-b71b-1c4c5c6625a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:05.620805 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a09c5-1a5a-4f20-b71b-1c4c5c6625a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:05.622299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a09c5-1a5a-4f20-b71b-1c4c5c6625a0 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:05.641027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 662/1316] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:18:08.736411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422d22a-85b3-426b-a6a8-c02ae9db0be8 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:08.736981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422d22a-85b3-426b-a6a8-c02ae9db0be8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:08.736981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422d22a-85b3-426b-a6a8-c02ae9db0be8 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:08.738332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 655/1317] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:08.743625 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041634e1-ec3e-4928-b25f-90cbe4afddea None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:08.744025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041634e1-ec3e-4928-b25f-90cbe4afddea None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:08.744256 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041634e1-ec3e-4928-b25f-90cbe4afddea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:08.806369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-041634e1-ec3e-4928-b25f-90cbe4afddea None None] MFA Rules not processed for user `90fb781936154a33addfe7c9d4af6617`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:08.807597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-041634e1-ec3e-4928-b25f-90cbe4afddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:08.899670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 663/1318] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:08.939313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422d22a-85b3-426b-a6a8-c02ae9db0be8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:08.940858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2422d22a-85b3-426b-a6a8-c02ae9db0be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:09.040776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422d22a-85b3-426b-a6a8-c02ae9db0be8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:09.110248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde0e76-13ff-4067-ab6b-f27391fbcc11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:09.110886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde0e76-13ff-4067-ab6b-f27391fbcc11 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:09.111191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde0e76-13ff-4067-ab6b-f27391fbcc11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:09.111471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde0e76-13ff-4067-ab6b-f27391fbcc11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:09.113108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2dde0e76-13ff-4067-ab6b-f27391fbcc11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:09.215598 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde0e76-13ff-4067-ab6b-f27391fbcc11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:09.217067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde0e76-13ff-4067-ab6b-f27391fbcc11 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:09.234804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 656/1319] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:18:12.218189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937bde9-2920-4603-b260-0ddf9a7a6820 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:12.218735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937bde9-2920-4603-b260-0ddf9a7a6820 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:12.218735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937bde9-2920-4603-b260-0ddf9a7a6820 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:12.220152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 664/1320] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:12.225442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1edf-8682-4c58-b96b-501bbc694542 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:12.225869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1edf-8682-4c58-b96b-501bbc694542 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:12.226502 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1edf-8682-4c58-b96b-501bbc694542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:12.296204 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4aab1edf-8682-4c58-b96b-501bbc694542 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:12.297324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4aab1edf-8682-4c58-b96b-501bbc694542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:12.389962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 657/1321] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:12.428790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937bde9-2920-4603-b260-0ddf9a7a6820 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:12.430321 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f937bde9-2920-4603-b260-0ddf9a7a6820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:12.529012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937bde9-2920-4603-b260-0ddf9a7a6820 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:12.599208 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef7a51-18f8-4c31-94c2-6db09ba6d852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:12.599785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef7a51-18f8-4c31-94c2-6db09ba6d852 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:12.600081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef7a51-18f8-4c31-94c2-6db09ba6d852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:12.600362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef7a51-18f8-4c31-94c2-6db09ba6d852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:12.602047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8cef7a51-18f8-4c31-94c2-6db09ba6d852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:12.706030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef7a51-18f8-4c31-94c2-6db09ba6d852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:12.707525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef7a51-18f8-4c31-94c2-6db09ba6d852 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:12.725003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 665/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:18:15.881681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb91614-9c11-4558-a5a1-0e37cfbd86aa None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:15.882240 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb91614-9c11-4558-a5a1-0e37cfbd86aa None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:15.882240 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb91614-9c11-4558-a5a1-0e37cfbd86aa None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:15.884364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 658/1323] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:15.890764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464598b-89dd-4754-949b-b5b9aad76a22 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:15.890764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464598b-89dd-4754-949b-b5b9aad76a22 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:15.890764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464598b-89dd-4754-949b-b5b9aad76a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:15.958922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f464598b-89dd-4754-949b-b5b9aad76a22 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:15.960670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f464598b-89dd-4754-949b-b5b9aad76a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:16.067889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 666/1324] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:16.105583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb91614-9c11-4558-a5a1-0e37cfbd86aa None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:16.107151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9bb91614-9c11-4558-a5a1-0e37cfbd86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:16.210630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb91614-9c11-4558-a5a1-0e37cfbd86aa None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:16.301413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b6c60-40f4-4868-8bf2-8c6651f1c8bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:16.302074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6c60-40f4-4868-8bf2-8c6651f1c8bc service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:16.302358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6c60-40f4-4868-8bf2-8c6651f1c8bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:16.302635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6c60-40f4-4868-8bf2-8c6651f1c8bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:16.304829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fb5b6c60-40f4-4868-8bf2-8c6651f1c8bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:16.411765 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b6c60-40f4-4868-8bf2-8c6651f1c8bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:16.413245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b6c60-40f4-4868-8bf2-8c6651f1c8bc service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:16.431672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 659/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:18:18.727533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80366438-7eed-4cf0-a6df-8062d0b1cafb None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:18.728100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80366438-7eed-4cf0-a6df-8062d0b1cafb None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:18.728100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80366438-7eed-4cf0-a6df-8062d0b1cafb None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:18.729482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 667/1326] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:18.734708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862310-3c93-47cb-8329-48bff7eead9c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:18.735177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862310-3c93-47cb-8329-48bff7eead9c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:18.735286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862310-3c93-47cb-8329-48bff7eead9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:18.799350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-82862310-3c93-47cb-8329-48bff7eead9c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:18.800551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-82862310-3c93-47cb-8329-48bff7eead9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:18.892699 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 660/1327] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:18.927908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80366438-7eed-4cf0-a6df-8062d0b1cafb None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:18.930059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-80366438-7eed-4cf0-a6df-8062d0b1cafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:19.033075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80366438-7eed-4cf0-a6df-8062d0b1cafb None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:19.103983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995429f-cf5e-4d4a-9d85-d44cdb8a6bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:19.104629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995429f-cf5e-4d4a-9d85-d44cdb8a6bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:19.104913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995429f-cf5e-4d4a-9d85-d44cdb8a6bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:19.105193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995429f-cf5e-4d4a-9d85-d44cdb8a6bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:19.106821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f995429f-cf5e-4d4a-9d85-d44cdb8a6bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:19.210907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995429f-cf5e-4d4a-9d85-d44cdb8a6bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:19.212405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995429f-cf5e-4d4a-9d85-d44cdb8a6bd5 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:19.231254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 668/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:18:21.523112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f61d-9437-46be-a30c-98fc1f45a477 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:21.523680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f61d-9437-46be-a30c-98fc1f45a477 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:21.523680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f61d-9437-46be-a30c-98fc1f45a477 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:21.525060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 661/1329] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:21.530504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a81fb-704d-4ef2-97a1-a2cdee2848bd None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:21.530957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a81fb-704d-4ef2-97a1-a2cdee2848bd None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:21.531066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a81fb-704d-4ef2-97a1-a2cdee2848bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:21.594769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e40a81fb-704d-4ef2-97a1-a2cdee2848bd None None] MFA Rules not processed for user `90fb781936154a33addfe7c9d4af6617`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:21.595925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e40a81fb-704d-4ef2-97a1-a2cdee2848bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:21.687810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 669/1330] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:21.724878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1f61d-9437-46be-a30c-98fc1f45a477 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:21.726921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-87e1f61d-9437-46be-a30c-98fc1f45a477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:21.829644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1f61d-9437-46be-a30c-98fc1f45a477 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:21.900558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71adab0-b05c-4069-a0a7-c99cc6a020fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:21.901212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71adab0-b05c-4069-a0a7-c99cc6a020fe service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:21.901494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71adab0-b05c-4069-a0a7-c99cc6a020fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:21.901770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71adab0-b05c-4069-a0a7-c99cc6a020fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:21.903464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d71adab0-b05c-4069-a0a7-c99cc6a020fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:22.018186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71adab0-b05c-4069-a0a7-c99cc6a020fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:22.019692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71adab0-b05c-4069-a0a7-c99cc6a020fe service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:22.036860 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 662/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:18:24.769572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96ce3-ebe8-4466-9f1a-6fbf24f31789 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:24.770099 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96ce3-ebe8-4466-9f1a-6fbf24f31789 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:24.770099 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96ce3-ebe8-4466-9f1a-6fbf24f31789 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:24.771462 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 670/1332] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:24.776687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4788a-192d-4fa8-bb29-c741f27d698f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:24.777069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4788a-192d-4fa8-bb29-c741f27d698f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:24.777284 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4788a-192d-4fa8-bb29-c741f27d698f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:24.840449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-caf4788a-192d-4fa8-bb29-c741f27d698f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:24.841630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-caf4788a-192d-4fa8-bb29-c741f27d698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:24.933811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 663/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:24.968845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96ce3-ebe8-4466-9f1a-6fbf24f31789 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:24.970380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-9ef96ce3-ebe8-4466-9f1a-6fbf24f31789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:25.073598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96ce3-ebe8-4466-9f1a-6fbf24f31789 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:25.147524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4233f-fdb3-4c61-821a-fc1abfdcd3b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:25.148842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4233f-fdb3-4c61-821a-fc1abfdcd3b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:25.149161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4233f-fdb3-4c61-821a-fc1abfdcd3b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:25.149476 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4233f-fdb3-4c61-821a-fc1abfdcd3b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:25.151283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-75a4233f-fdb3-4c61-821a-fc1abfdcd3b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:25.261451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4233f-fdb3-4c61-821a-fc1abfdcd3b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:25.262966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4233f-fdb3-4c61-821a-fc1abfdcd3b2 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:25.283739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 671/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:18:27.586632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9573-7bf8-4a75-a30d-f1874ac36974 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:27.587151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9573-7bf8-4a75-a30d-f1874ac36974 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:27.587151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9573-7bf8-4a75-a30d-f1874ac36974 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:27.588495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 664/1335] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:27.593818 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3c787-b719-4f01-88b5-2a69faabcc71 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:27.594245 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3c787-b719-4f01-88b5-2a69faabcc71 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:27.594379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3c787-b719-4f01-88b5-2a69faabcc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:27.657385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-bbc3c787-b719-4f01-88b5-2a69faabcc71 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:27.658611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-bbc3c787-b719-4f01-88b5-2a69faabcc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:27.751640 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 672/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:27.790987 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f9573-7bf8-4a75-a30d-f1874ac36974 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:27.792542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-488f9573-7bf8-4a75-a30d-f1874ac36974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:27.892142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f9573-7bf8-4a75-a30d-f1874ac36974 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:27.963532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52110449-1b8e-4adb-b67e-39008919650e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:27.964184 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52110449-1b8e-4adb-b67e-39008919650e service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:27.964475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52110449-1b8e-4adb-b67e-39008919650e service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:27.964751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52110449-1b8e-4adb-b67e-39008919650e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:27.966401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-52110449-1b8e-4adb-b67e-39008919650e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:28.082271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52110449-1b8e-4adb-b67e-39008919650e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:28.083789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52110449-1b8e-4adb-b67e-39008919650e service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:28.102703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 665/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:18:30.921491 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437715-9a15-4fd0-b4ac-acc242ef2438 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:30.922046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437715-9a15-4fd0-b4ac-acc242ef2438 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:30.922046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437715-9a15-4fd0-b4ac-acc242ef2438 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:30.923486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 673/1338] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:30.928635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd18f-e7de-4f0e-b719-56f61ed0d1a0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:30.929638 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd18f-e7de-4f0e-b719-56f61ed0d1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:30.929789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd18f-e7de-4f0e-b719-56f61ed0d1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:30.992937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-986fd18f-e7de-4f0e-b719-56f61ed0d1a0 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:30.994137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-986fd18f-e7de-4f0e-b719-56f61ed0d1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:31.088843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 666/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:31.128395 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437715-9a15-4fd0-b4ac-acc242ef2438 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:31.130022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-62437715-9a15-4fd0-b4ac-acc242ef2438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:31.230092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437715-9a15-4fd0-b4ac-acc242ef2438 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:31.299194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e19b5-6534-465b-af54-34c5f679771f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:31.299836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e19b5-6534-465b-af54-34c5f679771f service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:31.300115 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e19b5-6534-465b-af54-34c5f679771f service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:31.300395 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e19b5-6534-465b-af54-34c5f679771f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:31.302021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c93e19b5-6534-465b-af54-34c5f679771f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:31.406186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e19b5-6534-465b-af54-34c5f679771f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:31.407691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e19b5-6534-465b-af54-34c5f679771f service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:31.426154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 674/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:18:35.906688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ee9ed-8bca-4744-9f69-c0db324430c1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:35.907223 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ee9ed-8bca-4744-9f69-c0db324430c1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:35.907343 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ee9ed-8bca-4744-9f69-c0db324430c1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:35.908737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 667/1341] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:35.914003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990c78-e7e5-491b-b594-e3cede8ee2e0 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:35.914428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990c78-e7e5-491b-b594-e3cede8ee2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:35.914601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990c78-e7e5-491b-b594-e3cede8ee2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:35.985158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-6e990c78-e7e5-491b-b594-e3cede8ee2e0 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:35.986370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-6e990c78-e7e5-491b-b594-e3cede8ee2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:36.089839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 675/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:36.135308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ee9ed-8bca-4744-9f69-c0db324430c1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:36.137446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b10ee9ed-8bca-4744-9f69-c0db324430c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:36.227855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ee9ed-8bca-4744-9f69-c0db324430c1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:36.231363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b8773-70f5-48d7-a5f9-e3c3269a4482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:36.231997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8773-70f5-48d7-a5f9-e3c3269a4482 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:36.232276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8773-70f5-48d7-a5f9-e3c3269a4482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:36.232547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8773-70f5-48d7-a5f9-e3c3269a4482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:36.241181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b8773-70f5-48d7-a5f9-e3c3269a4482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:36.243185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b8773-70f5-48d7-a5f9-e3c3269a4482 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:36.252299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 668/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:18:39.848184 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddab78-bdd4-458e-ad23-3f30c74c2782 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:39.848718 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddab78-bdd4-458e-ad23-3f30c74c2782 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:39.848859 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddab78-bdd4-458e-ad23-3f30c74c2782 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:39.850263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 676/1344] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:39.856014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0d2cf-b9ff-4b78-a032-56c9f5287ae7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:39.856462 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0d2cf-b9ff-4b78-a032-56c9f5287ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:39.856703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0d2cf-b9ff-4b78-a032-56c9f5287ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:39.884657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4ec0d2cf-b9ff-4b78-a032-56c9f5287ae7 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:39.885854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4ec0d2cf-b9ff-4b78-a032-56c9f5287ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:39.962114 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 669/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:39.999695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddab78-bdd4-458e-ad23-3f30c74c2782 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:40.010077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddab78-bdd4-458e-ad23-3f30c74c2782 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:40.013582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbf856-0d8c-4717-8bc1-273cd3e44fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:40.014283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbf856-0d8c-4717-8bc1-273cd3e44fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:40.014630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbf856-0d8c-4717-8bc1-273cd3e44fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:40.014967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbf856-0d8c-4717-8bc1-273cd3e44fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:40.023747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbf856-0d8c-4717-8bc1-273cd3e44fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:40.025259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbf856-0d8c-4717-8bc1-273cd3e44fbd service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:40.034851 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 677/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:18:44.914382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8dd00-83ce-4cd9-843c-88b4f1ffbdb3 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:44.914912 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8dd00-83ce-4cd9-843c-88b4f1ffbdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:44.915039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8dd00-83ce-4cd9-843c-88b4f1ffbdb3 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:44.916328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 670/1347] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:44.921788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee86480-f266-4d07-9d77-3e9d928a57c5 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:44.922206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee86480-f266-4d07-9d77-3e9d928a57c5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:44.922352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee86480-f266-4d07-9d77-3e9d928a57c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:44.940149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-7ee86480-f266-4d07-9d77-3e9d928a57c5 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:44.941363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7ee86480-f266-4d07-9d77-3e9d928a57c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:44.949861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 678/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:44.988486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8dd00-83ce-4cd9-843c-88b4f1ffbdb3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:18:44.999746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8dd00-83ce-4cd9-843c-88b4f1ffbdb3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:18:45.003152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093d952-95c9-44ce-b56b-9c0929ccaaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:18:45.003795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093d952-95c9-44ce-b56b-9c0929ccaaaa service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:45.004076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093d952-95c9-44ce-b56b-9c0929ccaaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:45.004352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093d952-95c9-44ce-b56b-9c0929ccaaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:45.013102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093d952-95c9-44ce-b56b-9c0929ccaaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:18:45.014555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093d952-95c9-44ce-b56b-9c0929ccaaaa service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:18:45.024499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 671/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:18:50.303972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430d3a9-dd41-4168-9a08-7f9c82113ac9 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:50.305014 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430d3a9-dd41-4168-9a08-7f9c82113ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:50.305458 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430d3a9-dd41-4168-9a08-7f9c82113ac9 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:50.308345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 679/1350] 10.222.0.64 () {54 vars in 921 bytes} [Fri May 13 17:18:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:50.313383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018b740-9c60-4736-a867-7f854352774c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:50.313853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018b740-9c60-4736-a867-7f854352774c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:50.313959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018b740-9c60-4736-a867-7f854352774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:50.456156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c018b740-9c60-4736-a867-7f854352774c None None] MFA Rules not processed for user `b84ae21424694df68a96b928e15e9240`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:50.457747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c018b740-9c60-4736-a867-7f854352774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:50.535702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 672/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Fri May 13 17:18:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:54.774812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2e24f-8e76-4815-a3c7-02adbdf6ca1a None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:54.775817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2e24f-8e76-4815-a3c7-02adbdf6ca1a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:54.776454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2e24f-8e76-4815-a3c7-02adbdf6ca1a None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:54.778137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 680/1352] 10.222.0.64 () {54 vars in 921 bytes} [Fri May 13 17:18:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:54.783516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670f889-f901-495d-b4e1-3d98ee2e76e9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:54.783930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670f889-f901-495d-b4e1-3d98ee2e76e9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:54.784150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670f889-f901-495d-b4e1-3d98ee2e76e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:54.803772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d670f889-f901-495d-b4e1-3d98ee2e76e9 None None] MFA Rules not processed for user `b84ae21424694df68a96b928e15e9240`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:54.805540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d670f889-f901-495d-b4e1-3d98ee2e76e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:54.814331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 673/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Fri May 13 17:18:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:18:56.532006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849d158-6b0f-40dd-afe5-8989dfdf0752 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:56.532561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849d158-6b0f-40dd-afe5-8989dfdf0752 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:56.532561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849d158-6b0f-40dd-afe5-8989dfdf0752 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:56.533939 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 681/1354] 10.222.0.64 () {54 vars in 921 bytes} [Fri May 13 17:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:18:56.539347 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1f30a-4d65-47ef-ae30-52e253f1eaab None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:18:56.539810 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1f30a-4d65-47ef-ae30-52e253f1eaab None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:18:56.539910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1f30a-4d65-47ef-ae30-52e253f1eaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:18:56.558192 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f5c1f30a-4d65-47ef-ae30-52e253f1eaab None None] MFA Rules not processed for user `b84ae21424694df68a96b928e15e9240`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:18:56.559433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f5c1f30a-4d65-47ef-ae30-52e253f1eaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:18:56.568074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 674/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Fri May 13 17:18:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:00.284155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9cb70-de20-404c-950d-5555cf3d37b9 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:00.284667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9cb70-de20-404c-950d-5555cf3d37b9 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:00.284667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9cb70-de20-404c-950d-5555cf3d37b9 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:00.286209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 682/1356] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:00.291441 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d71c-1d84-48f1-b866-236ef392afc1 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:00.291883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d71c-1d84-48f1-b866-236ef392afc1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:00.291978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d71c-1d84-48f1-b866-236ef392afc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:00.309659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ea19d71c-1d84-48f1-b866-236ef392afc1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:00.310831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ea19d71c-1d84-48f1-b866-236ef392afc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:00.318763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 675/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:00.367635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f662-1339-4a02-88a4-68efeecb2cc2 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:00.367970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f662-1339-4a02-88a4-68efeecb2cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:00.370294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f662-1339-4a02-88a4-68efeecb2cc2 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:00.370294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 683/1358] 10.222.0.64 () {54 vars in 961 bytes} [Fri May 13 17:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:00.375107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5caad2-82bd-4131-8b9f-1e560b21befa None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:00.375449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5caad2-82bd-4131-8b9f-1e560b21befa None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:00.375730 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5caad2-82bd-4131-8b9f-1e560b21befa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:00.433271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3a5caad2-82bd-4131-8b9f-1e560b21befa None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:00.435411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3a5caad2-82bd-4131-8b9f-1e560b21befa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:00.525313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 676/1359] 10.222.0.64 () {58 vars in 1058 bytes} [Fri May 13 17:19:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:00.534242 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26f662-1339-4a02-88a4-68efeecb2cc2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:00.549052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26f662-1339-4a02-88a4-68efeecb2cc2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:00.555908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50cea9-23c7-42c1-911f-b7cc938e0bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:00.556747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50cea9-23c7-42c1-911f-b7cc938e0bcc service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:00.557284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50cea9-23c7-42c1-911f-b7cc938e0bcc service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:00.557942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50cea9-23c7-42c1-911f-b7cc938e0bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:00.567014 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50cea9-23c7-42c1-911f-b7cc938e0bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:00.569139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50cea9-23c7-42c1-911f-b7cc938e0bcc service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:00.582018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 684/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:19:03.049988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f2fb1-6945-4d54-a44d-c918a7c00c20 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:03.050502 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f2fb1-6945-4d54-a44d-c918a7c00c20 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:03.050615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f2fb1-6945-4d54-a44d-c918a7c00c20 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:03.052088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 677/1361] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:03.057893 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8356c08-a73c-4d2a-9ba4-ce710766e64c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:03.058316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8356c08-a73c-4d2a-9ba4-ce710766e64c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:03.058455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8356c08-a73c-4d2a-9ba4-ce710766e64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:03.076381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e8356c08-a73c-4d2a-9ba4-ce710766e64c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:03.077866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e8356c08-a73c-4d2a-9ba4-ce710766e64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:03.086336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 685/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:03.130744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f2fb1-6945-4d54-a44d-c918a7c00c20 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:03.145678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f2fb1-6945-4d54-a44d-c918a7c00c20 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:03.152113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b327528-3f03-47ee-9a94-6fa46fb83088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:03.152756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b327528-3f03-47ee-9a94-6fa46fb83088 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:03.153046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b327528-3f03-47ee-9a94-6fa46fb83088 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:03.153323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b327528-3f03-47ee-9a94-6fa46fb83088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:03.162667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b327528-3f03-47ee-9a94-6fa46fb83088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:03.164319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b327528-3f03-47ee-9a94-6fa46fb83088 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:03.173927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 678/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:05.899890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3437c78-e986-4cb4-81fd-7e557a092915 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:05.900392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3437c78-e986-4cb4-81fd-7e557a092915 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:05.900475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3437c78-e986-4cb4-81fd-7e557a092915 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:05.901842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 686/1364] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:05.907303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cb903-5b58-4b6b-8175-7aec1c212cc8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:05.907714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cb903-5b58-4b6b-8175-7aec1c212cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:05.907862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cb903-5b58-4b6b-8175-7aec1c212cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:05.926403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1e0cb903-5b58-4b6b-8175-7aec1c212cc8 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:05.927535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1e0cb903-5b58-4b6b-8175-7aec1c212cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:05.935892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 679/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:19:05.981620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b99f80-e72d-4bdb-9a03-ea410cc378ea None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:05.981921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b99f80-e72d-4bdb-9a03-ea410cc378ea None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:05.982175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b99f80-e72d-4bdb-9a03-ea410cc378ea None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:05.983573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 687/1366] 10.222.0.64 () {54 vars in 961 bytes} [Fri May 13 17:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:05.988927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce820b-fbde-4526-bb98-ff785b436145 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:05.989212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce820b-fbde-4526-bb98-ff785b436145 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:05.989487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce820b-fbde-4526-bb98-ff785b436145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:06.008257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-57ce820b-fbde-4526-bb98-ff785b436145 None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:06.009448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-57ce820b-fbde-4526-bb98-ff785b436145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:06.018771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 680/1367] 10.222.0.64 () {58 vars in 1058 bytes} [Fri May 13 17:19:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:19:06.026271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b99f80-e72d-4bdb-9a03-ea410cc378ea None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:06.040826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b99f80-e72d-4bdb-9a03-ea410cc378ea None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:06.046155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32729177-1940-43a0-9432-2abf85dc7b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:06.046787 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32729177-1940-43a0-9432-2abf85dc7b5d service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:06.047070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32729177-1940-43a0-9432-2abf85dc7b5d service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:06.047390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32729177-1940-43a0-9432-2abf85dc7b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:06.055781 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32729177-1940-43a0-9432-2abf85dc7b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:06.057369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32729177-1940-43a0-9432-2abf85dc7b5d service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:06.066652 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 688/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:08.667371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c78b4e-c14c-4a59-a914-aa3b946adb74 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:08.667953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c78b4e-c14c-4a59-a914-aa3b946adb74 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:08.667953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c78b4e-c14c-4a59-a914-aa3b946adb74 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:08.669689 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 681/1369] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:08.676530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232889a-7ba0-4a77-907c-ffcd5cffb517 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:08.677088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232889a-7ba0-4a77-907c-ffcd5cffb517 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:08.677200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232889a-7ba0-4a77-907c-ffcd5cffb517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:08.688382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49963ebf-31cb-4005-9116-bc6b0b86562c None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:08.688672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49963ebf-31cb-4005-9116-bc6b0b86562c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:08.689130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49963ebf-31cb-4005-9116-bc6b0b86562c None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:08.690552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 682/1370] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:19:08.695965 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d232889a-7ba0-4a77-907c-ffcd5cffb517 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:08.697590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d232889a-7ba0-4a77-907c-ffcd5cffb517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:08.700384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6f4c-3f14-445c-a76c-8b445134a982 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:08.700909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6f4c-3f14-445c-a76c-8b445134a982 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:08.701193 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6f4c-3f14-445c-a76c-8b445134a982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:08.707121 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 689/1371] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:08.723681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-766a6f4c-3f14-445c-a76c-8b445134a982 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:08.725215 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-766a6f4c-3f14-445c-a76c-8b445134a982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:08.733957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 683/1372] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:19:08.781619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232889a-7ba0-4a77-907c-ffcd5cffb517 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:08.794872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232889a-7ba0-4a77-907c-ffcd5cffb517 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:08.801230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5cc4a-07e7-4ea3-8d08-c0f7e2557cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:08.801985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5cc4a-07e7-4ea3-8d08-c0f7e2557cfb service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:08.802391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5cc4a-07e7-4ea3-8d08-c0f7e2557cfb service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:08.802761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5cc4a-07e7-4ea3-8d08-c0f7e2557cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:08.811915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5cc4a-07e7-4ea3-8d08-c0f7e2557cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:08.813902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5cc4a-07e7-4ea3-8d08-c0f7e2557cfb service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:08.824314 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 690/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:09.029811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2259250-9de1-416a-8083-23257936a5a8 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:09.029811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2259250-9de1-416a-8083-23257936a5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:09.029811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2259250-9de1-416a-8083-23257936a5a8 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:09.032539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 684/1374] 10.222.0.64 () {54 vars in 963 bytes} [Fri May 13 17:19:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:09.038106 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b42114-587e-4277-b387-a3a6e04aa5eb None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:09.038842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b42114-587e-4277-b387-a3a6e04aa5eb None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:09.039396 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b42114-587e-4277-b387-a3a6e04aa5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:09.098048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-70b42114-587e-4277-b387-a3a6e04aa5eb None None] MFA Rules not processed for user `cd116be69d7f4cffb770940ccb7514fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:09.099794 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-70b42114-587e-4277-b387-a3a6e04aa5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:09.175751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 691/1375] 10.222.0.64 () {58 vars in 1060 bytes} [Fri May 13 17:19:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:09.183515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2259250-9de1-416a-8083-23257936a5a8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:09.194598 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2259250-9de1-416a-8083-23257936a5a8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:09.199074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9b66-52c7-44d8-b50f-9ae6449e464a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:09.199895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9b66-52c7-44d8-b50f-9ae6449e464a service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:09.200287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9b66-52c7-44d8-b50f-9ae6449e464a service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:09.200688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9b66-52c7-44d8-b50f-9ae6449e464a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:09.211497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9b66-52c7-44d8-b50f-9ae6449e464a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:09.213108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9b66-52c7-44d8-b50f-9ae6449e464a service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:09.231352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 685/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:11.239563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f014bf-d451-4732-9d4d-32a1dd20cbde None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:11.240427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f014bf-d451-4732-9d4d-32a1dd20cbde None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:11.240710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f014bf-d451-4732-9d4d-32a1dd20cbde None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:11.242109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 692/1377] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:11.247564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b47db3-4816-4eeb-b3b6-7874df070e3e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:11.247987 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b47db3-4816-4eeb-b3b6-7874df070e3e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:11.248099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b47db3-4816-4eeb-b3b6-7874df070e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:11.266399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-59b47db3-4816-4eeb-b3b6-7874df070e3e None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:11.267635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-59b47db3-4816-4eeb-b3b6-7874df070e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:11.276077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 686/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:11.319238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f014bf-d451-4732-9d4d-32a1dd20cbde None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:11.336052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f014bf-d451-4732-9d4d-32a1dd20cbde None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:11.341608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b720a1-e9d9-4151-82b4-acf1fe00bc11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:11.345250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b720a1-e9d9-4151-82b4-acf1fe00bc11 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:11.345250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b720a1-e9d9-4151-82b4-acf1fe00bc11 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:11.345250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b720a1-e9d9-4151-82b4-acf1fe00bc11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:11.352850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b720a1-e9d9-4151-82b4-acf1fe00bc11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:11.354403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b720a1-e9d9-4151-82b4-acf1fe00bc11 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:11.364555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 693/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:13.736912 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e15abe-4588-4cb4-bebd-c12f5f39c1bb None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:13.737446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e15abe-4588-4cb4-bebd-c12f5f39c1bb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:13.737446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e15abe-4588-4cb4-bebd-c12f5f39c1bb None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:13.738968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 687/1380] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:13.744874 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b1ed7-f4e6-4162-83e4-c3593f139330 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:13.745330 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b1ed7-f4e6-4162-83e4-c3593f139330 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:13.745605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b1ed7-f4e6-4162-83e4-c3593f139330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:13.763617 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-848b1ed7-f4e6-4162-83e4-c3593f139330 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:13.765075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-848b1ed7-f4e6-4162-83e4-c3593f139330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:13.773539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 694/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:13.816568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e15abe-4588-4cb4-bebd-c12f5f39c1bb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:13.830555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e15abe-4588-4cb4-bebd-c12f5f39c1bb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:13.836864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895eb35-e8ec-4441-8aea-1bac6e403c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:13.837490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895eb35-e8ec-4441-8aea-1bac6e403c4c service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:13.837774 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895eb35-e8ec-4441-8aea-1bac6e403c4c service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:13.838046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895eb35-e8ec-4441-8aea-1bac6e403c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:13.846075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895eb35-e8ec-4441-8aea-1bac6e403c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:13.847805 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895eb35-e8ec-4441-8aea-1bac6e403c4c service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:13.858898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 688/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:16.300168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10c3ae-4041-4025-964b-190a627f62ec None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:16.300726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10c3ae-4041-4025-964b-190a627f62ec None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:16.300918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10c3ae-4041-4025-964b-190a627f62ec None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:16.302389 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 695/1383] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:16.308281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07375-7695-4f0f-a65b-d1977f533691 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:16.308699 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07375-7695-4f0f-a65b-d1977f533691 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:16.308842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07375-7695-4f0f-a65b-d1977f533691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:16.326974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-09b07375-7695-4f0f-a65b-d1977f533691 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:16.328406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-09b07375-7695-4f0f-a65b-d1977f533691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:16.337709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 689/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:16.379045 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10c3ae-4041-4025-964b-190a627f62ec None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:16.393725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10c3ae-4041-4025-964b-190a627f62ec None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:16.399299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d58b2e-03fc-43c9-a3ed-e7f621050c37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:16.399938 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d58b2e-03fc-43c9-a3ed-e7f621050c37 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:16.400222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d58b2e-03fc-43c9-a3ed-e7f621050c37 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:16.400497 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d58b2e-03fc-43c9-a3ed-e7f621050c37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:16.408505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d58b2e-03fc-43c9-a3ed-e7f621050c37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:16.410085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d58b2e-03fc-43c9-a3ed-e7f621050c37 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:16.419593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 696/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:19.030304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774472-8813-4d09-8652-6608457db7fe None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:19.030880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774472-8813-4d09-8652-6608457db7fe None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:19.030880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774472-8813-4d09-8652-6608457db7fe None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:19.032255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 690/1386] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:19.038863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c06f2-42bd-4fe3-ac7d-1248eb3849dc None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:19.039346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c06f2-42bd-4fe3-ac7d-1248eb3849dc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:19.039559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c06f2-42bd-4fe3-ac7d-1248eb3849dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:19.058965 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-cb7c06f2-42bd-4fe3-ac7d-1248eb3849dc None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:19.060210 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-cb7c06f2-42bd-4fe3-ac7d-1248eb3849dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:19.068120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 697/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:19.118012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774472-8813-4d09-8652-6608457db7fe None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:19.132166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774472-8813-4d09-8652-6608457db7fe None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:19.138224 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5d6fb-0ae5-4f05-a001-20a2d77ae346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:19.138872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5d6fb-0ae5-4f05-a001-20a2d77ae346 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:19.139150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5d6fb-0ae5-4f05-a001-20a2d77ae346 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:19.139436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5d6fb-0ae5-4f05-a001-20a2d77ae346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:19.147629 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5d6fb-0ae5-4f05-a001-20a2d77ae346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:19.149270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5d6fb-0ae5-4f05-a001-20a2d77ae346 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:19.158570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 691/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:21.589189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2119a-bb76-45a2-97a5-08b8b650a10f None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:21.589890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2119a-bb76-45a2-97a5-08b8b650a10f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:21.589890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2119a-bb76-45a2-97a5-08b8b650a10f None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:21.591089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 698/1389] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:21.596443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc1ba4-65aa-4d92-ad5d-592ef97a53cb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:21.596922 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc1ba4-65aa-4d92-ad5d-592ef97a53cb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:21.597017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc1ba4-65aa-4d92-ad5d-592ef97a53cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:21.614959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-68cc1ba4-65aa-4d92-ad5d-592ef97a53cb None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:21.616185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-68cc1ba4-65aa-4d92-ad5d-592ef97a53cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:21.623978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 692/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:21.668438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2119a-bb76-45a2-97a5-08b8b650a10f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:21.686306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2119a-bb76-45a2-97a5-08b8b650a10f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:21.692477 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39874c-a25e-4f9b-b9b6-bc9945409e5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:21.693134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39874c-a25e-4f9b-b9b6-bc9945409e5b service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:21.693453 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39874c-a25e-4f9b-b9b6-bc9945409e5b service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:21.693697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39874c-a25e-4f9b-b9b6-bc9945409e5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:21.702578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39874c-a25e-4f9b-b9b6-bc9945409e5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:21.704236 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39874c-a25e-4f9b-b9b6-bc9945409e5b service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:21.714662 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 699/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:24.133279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef91b81-cf2a-4d59-aa1e-352b04271088 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:24.133862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef91b81-cf2a-4d59-aa1e-352b04271088 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:24.133862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef91b81-cf2a-4d59-aa1e-352b04271088 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:24.135196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 693/1392] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:24.140590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8393348-d9c4-45b4-9978-ce0901eb4480 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:24.141063 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8393348-d9c4-45b4-9978-ce0901eb4480 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:24.141294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8393348-d9c4-45b4-9978-ce0901eb4480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:24.158691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e8393348-d9c4-45b4-9978-ce0901eb4480 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:24.159922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e8393348-d9c4-45b4-9978-ce0901eb4480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:24.168222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 700/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:24.211145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef91b81-cf2a-4d59-aa1e-352b04271088 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:24.225064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef91b81-cf2a-4d59-aa1e-352b04271088 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:24.231200 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fccd0-d3e0-42e3-a97e-9ec7cd09d6e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:24.231864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fccd0-d3e0-42e3-a97e-9ec7cd09d6e6 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:24.232166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fccd0-d3e0-42e3-a97e-9ec7cd09d6e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:24.232448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fccd0-d3e0-42e3-a97e-9ec7cd09d6e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:24.240706 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fccd0-d3e0-42e3-a97e-9ec7cd09d6e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:24.242319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fccd0-d3e0-42e3-a97e-9ec7cd09d6e6 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:24.252361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 694/1394] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:25.181671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287760a-5795-4451-a2f1-20aeed7699f6 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:25.182260 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287760a-5795-4451-a2f1-20aeed7699f6 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:25.182260 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287760a-5795-4451-a2f1-20aeed7699f6 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:25.183661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 701/1395] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:25.189015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52aac4-c69f-4c43-9a8d-74053747ea72 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:25.189458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52aac4-c69f-4c43-9a8d-74053747ea72 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:25.189666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52aac4-c69f-4c43-9a8d-74053747ea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:25.208309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ca52aac4-c69f-4c43-9a8d-74053747ea72 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:25.209500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ca52aac4-c69f-4c43-9a8d-74053747ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:25.217550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 695/1396] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:25.273502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8760597-7b2b-44d9-85ef-ddff1f16164d None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:25.273794 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8760597-7b2b-44d9-85ef-ddff1f16164d None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:25.274077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8760597-7b2b-44d9-85ef-ddff1f16164d None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:25.275493 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 702/1397] 10.222.0.64 () {54 vars in 962 bytes} [Fri May 13 17:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:25.280535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6632-b009-4cd4-bdc1-a43a1a2c175d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:25.280929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6632-b009-4cd4-bdc1-a43a1a2c175d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:25.281273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6632-b009-4cd4-bdc1-a43a1a2c175d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:25.329253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-dffc6632-b009-4cd4-bdc1-a43a1a2c175d None None] MFA Rules not processed for user `8e00de466abe41da8e6d7dbbd71f5270`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:25.330578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dffc6632-b009-4cd4-bdc1-a43a1a2c175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:25.389465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 696/1398] 10.222.0.64 () {58 vars in 1059 bytes} [Fri May 13 17:19:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:25.396920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8760597-7b2b-44d9-85ef-ddff1f16164d None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:25.407102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8760597-7b2b-44d9-85ef-ddff1f16164d None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:25.410611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226728d7-2d45-4b62-b955-18b53b41d1ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e00de466abe41da8e6d7dbbd71f5270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:25.411275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226728d7-2d45-4b62-b955-18b53b41d1ab service glance] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:25.411569 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226728d7-2d45-4b62-b955-18b53b41d1ab service glance] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:25.411848 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226728d7-2d45-4b62-b955-18b53b41d1ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:25.420984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226728d7-2d45-4b62-b955-18b53b41d1ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:25.422421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226728d7-2d45-4b62-b955-18b53b41d1ab service glance] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:25.432104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 703/1399] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:26.046703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbc6c-7747-4acd-9d35-e8ee9177c7d7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:26.047047 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbc6c-7747-4acd-9d35-e8ee9177c7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:26.047365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbc6c-7747-4acd-9d35-e8ee9177c7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:26.094913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-032bbc6c-7747-4acd-9d35-e8ee9177c7d7 None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:26.096089 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-032bbc6c-7747-4acd-9d35-e8ee9177c7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:26.161772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 697/1400] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:19:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:26.206548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d56732-66c4-4c98-8b6b-ea43e53856b3 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:26.207028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d56732-66c4-4c98-8b6b-ea43e53856b3 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:26.207175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d56732-66c4-4c98-8b6b-ea43e53856b3 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:26.208543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 704/1401] 10.222.0.64 () {54 vars in 942 bytes} [Fri May 13 17:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:26.215168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e05cc-2a6d-4e26-b44f-2bc17cf57339 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:26.215607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e05cc-2a6d-4e26-b44f-2bc17cf57339 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:26.215714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e05cc-2a6d-4e26-b44f-2bc17cf57339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:26.264014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-db5e05cc-2a6d-4e26-b44f-2bc17cf57339 None None] MFA Rules not processed for user `973cc524d553428aa2b2763ce28cc920`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:26.265226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-db5e05cc-2a6d-4e26-b44f-2bc17cf57339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:26.336818 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 698/1402] 10.222.0.64 () {58 vars in 1039 bytes} [Fri May 13 17:19:26 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:26.346189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d56732-66c4-4c98-8b6b-ea43e53856b3 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:26.360084 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d56732-66c4-4c98-8b6b-ea43e53856b3 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:26.365048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b2918-aad2-4537-9796-45f43a254a88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:26.365691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b2918-aad2-4537-9796-45f43a254a88 service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:26.365978 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b2918-aad2-4537-9796-45f43a254a88 service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:26.366255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b2918-aad2-4537-9796-45f43a254a88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:26.374976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b2918-aad2-4537-9796-45f43a254a88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:26.376703 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b2918-aad2-4537-9796-45f43a254a88 service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:26.384791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 705/1403] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:19:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:19:26.753908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684a3b-0af1-42a9-8555-237b5061a4ec None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:26.754268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684a3b-0af1-42a9-8555-237b5061a4ec None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:26.754495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684a3b-0af1-42a9-8555-237b5061a4ec None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:26.756482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 699/1404] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:26.761664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c68d05-12ea-462d-b42e-e79585ddec6e None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:26.762181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c68d05-12ea-462d-b42e-e79585ddec6e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:26.762473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c68d05-12ea-462d-b42e-e79585ddec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:26.781131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e4c68d05-12ea-462d-b42e-e79585ddec6e None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:26.782576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e4c68d05-12ea-462d-b42e-e79585ddec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:26.793815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 706/1405] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:26.834369 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61684a3b-0af1-42a9-8555-237b5061a4ec None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:26.849700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61684a3b-0af1-42a9-8555-237b5061a4ec None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:26.855859 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1fd47-a902-4700-80f5-74eb339d0bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:26.856494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1fd47-a902-4700-80f5-74eb339d0bae service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:26.856781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1fd47-a902-4700-80f5-74eb339d0bae service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:26.857061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1fd47-a902-4700-80f5-74eb339d0bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:26.866687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1fd47-a902-4700-80f5-74eb339d0bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:26.866843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1fd47-a902-4700-80f5-74eb339d0bae service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:26.876835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 700/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:29.278689 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13b1b-261d-4bb5-8530-9c16bb2c9427 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:29.279243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13b1b-261d-4bb5-8530-9c16bb2c9427 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:29.279243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13b1b-261d-4bb5-8530-9c16bb2c9427 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:29.280602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 707/1407] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:29.287448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de60f5-0b82-4515-9362-8b9ec675f8ba None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:29.287448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de60f5-0b82-4515-9362-8b9ec675f8ba None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:29.287448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de60f5-0b82-4515-9362-8b9ec675f8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:29.311854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b4de60f5-0b82-4515-9362-8b9ec675f8ba None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:29.313099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b4de60f5-0b82-4515-9362-8b9ec675f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:29.321434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 701/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:29.381521 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f13b1b-261d-4bb5-8530-9c16bb2c9427 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:29.406868 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f13b1b-261d-4bb5-8530-9c16bb2c9427 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:29.417811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d06a8-7b91-4940-9065-a2cf4a1b8fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:29.418883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d06a8-7b91-4940-9065-a2cf4a1b8fa7 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:29.419417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d06a8-7b91-4940-9065-a2cf4a1b8fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:29.419917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d06a8-7b91-4940-9065-a2cf4a1b8fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:29.435638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d06a8-7b91-4940-9065-a2cf4a1b8fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:29.437633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d06a8-7b91-4940-9065-a2cf4a1b8fa7 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:29.450837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 708/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:19:50.538814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b84f4-2b56-4a65-9ac4-88b975f5c1f1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:50.539499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b84f4-2b56-4a65-9ac4-88b975f5c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:50.539499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b84f4-2b56-4a65-9ac4-88b975f5c1f1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:50.541311 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 702/1410] 10.222.0.64 () {54 vars in 918 bytes} [Fri May 13 17:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:50.546909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a49e0-380f-4cf0-b914-eae34b1ae408 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:50.547404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a49e0-380f-4cf0-b914-eae34b1ae408 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:50.547513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a49e0-380f-4cf0-b914-eae34b1ae408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:50.565565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f64a49e0-380f-4cf0-b914-eae34b1ae408 None None] MFA Rules not processed for user `b84ae21424694df68a96b928e15e9240`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:50.566763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f64a49e0-380f-4cf0-b914-eae34b1ae408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:50.575415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 709/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Fri May 13 17:19:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:50.590095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1da15-9496-44da-8b6c-8e9ab23b882e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:50.590383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1da15-9496-44da-8b6c-8e9ab23b882e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:50.590660 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1da15-9496-44da-8b6c-8e9ab23b882e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:50.592045 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 703/1412] 10.222.0.64 () {54 vars in 918 bytes} [Fri May 13 17:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:50.596626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112621bf-8a2d-4af0-a14e-900994f0e71c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:50.596919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112621bf-8a2d-4af0-a14e-900994f0e71c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:50.597199 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112621bf-8a2d-4af0-a14e-900994f0e71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:50.615176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-112621bf-8a2d-4af0-a14e-900994f0e71c None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:50.616371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-112621bf-8a2d-4af0-a14e-900994f0e71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:50.625909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 710/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Fri May 13 17:19:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:53.320295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41abbf-45f9-4cbc-8752-58ce6986c0be None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:53.320807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41abbf-45f9-4cbc-8752-58ce6986c0be None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:53.320807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41abbf-45f9-4cbc-8752-58ce6986c0be None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:53.322664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:53.328146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537f3ae-2dc1-4c46-ab8b-7ccfc5b1c9a2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:53.328660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537f3ae-2dc1-4c46-ab8b-7ccfc5b1c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:53.328773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537f3ae-2dc1-4c46-ab8b-7ccfc5b1c9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:53.347568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c537f3ae-2dc1-4c46-ab8b-7ccfc5b1c9a2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:53.348765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c537f3ae-2dc1-4c46-ab8b-7ccfc5b1c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:53.356716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:19:53.398422 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41abbf-45f9-4cbc-8752-58ce6986c0be None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:53.413360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41abbf-45f9-4cbc-8752-58ce6986c0be None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:53.419154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a08c6b-e47c-4155-b2d6-d4356286a8fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:53.419801 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a08c6b-e47c-4155-b2d6-d4356286a8fa service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:53.420084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a08c6b-e47c-4155-b2d6-d4356286a8fa service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:53.420360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a08c6b-e47c-4155-b2d6-d4356286a8fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:53.428481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a08c6b-e47c-4155-b2d6-d4356286a8fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:53.430087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a08c6b-e47c-4155-b2d6-d4356286a8fa service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:53.439327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 705/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:54.420209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753c94a-9b3e-4817-aff7-479bc0ea4800 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:54.420770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753c94a-9b3e-4817-aff7-479bc0ea4800 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:54.420770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753c94a-9b3e-4817-aff7-479bc0ea4800 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:54.422156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:54.427356 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2c43-6b21-4739-b290-1daf8071c52f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:54.427767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2c43-6b21-4739-b290-1daf8071c52f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:54.427894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2c43-6b21-4739-b290-1daf8071c52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:54.446247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-972d2c43-6b21-4739-b290-1daf8071c52f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:54.448072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-972d2c43-6b21-4739-b290-1daf8071c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:54.455868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:54.617875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753c94a-9b3e-4817-aff7-479bc0ea4800 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:54.632055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753c94a-9b3e-4817-aff7-479bc0ea4800 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:54.637923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785ff12-6192-493f-a467-de7bf300b37c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:54.638545 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785ff12-6192-493f-a467-de7bf300b37c service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:54.638825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785ff12-6192-493f-a467-de7bf300b37c service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:54.639096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785ff12-6192-493f-a467-de7bf300b37c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:54.646837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785ff12-6192-493f-a467-de7bf300b37c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:54.648457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785ff12-6192-493f-a467-de7bf300b37c service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:54.657452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 713/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:55.614994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f5fae-b0a2-4e88-96d2-fd0a029def19 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:55.615596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f5fae-b0a2-4e88-96d2-fd0a029def19 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:55.615596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f5fae-b0a2-4e88-96d2-fd0a029def19 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:55.616973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:55.622004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a336ccd-12eb-4f93-afba-3dac3df8d050 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:55.622429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a336ccd-12eb-4f93-afba-3dac3df8d050 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:55.622536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a336ccd-12eb-4f93-afba-3dac3df8d050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:55.640367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-7a336ccd-12eb-4f93-afba-3dac3df8d050 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:55.641545 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7a336ccd-12eb-4f93-afba-3dac3df8d050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:55.649163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:55.797497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f5fae-b0a2-4e88-96d2-fd0a029def19 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:55.811913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f5fae-b0a2-4e88-96d2-fd0a029def19 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:55.817200 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad136e7-e04b-4805-af71-113f63a4605c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:55.817826 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad136e7-e04b-4805-af71-113f63a4605c service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:55.818106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad136e7-e04b-4805-af71-113f63a4605c service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:55.818377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad136e7-e04b-4805-af71-113f63a4605c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:55.826740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad136e7-e04b-4805-af71-113f63a4605c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:55.828374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad136e7-e04b-4805-af71-113f63a4605c service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:55.837719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 708/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:56.758903 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7273-f9ac-4e5e-a8e1-e642eaf10acb None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:56.759485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7273-f9ac-4e5e-a8e1-e642eaf10acb None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:56.759485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7273-f9ac-4e5e-a8e1-e642eaf10acb None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:56.760882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:56.765903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb7d2a-dfbe-47e8-9bc0-b2b14c5efd2e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:56.766354 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb7d2a-dfbe-47e8-9bc0-b2b14c5efd2e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:56.766473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb7d2a-dfbe-47e8-9bc0-b2b14c5efd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:56.785378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c7bb7d2a-dfbe-47e8-9bc0-b2b14c5efd2e None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:56.786561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c7bb7d2a-dfbe-47e8-9bc0-b2b14c5efd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:56.794294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:56.958172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7273-f9ac-4e5e-a8e1-e642eaf10acb None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:56.973234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7273-f9ac-4e5e-a8e1-e642eaf10acb None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:56.978710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0bfaf-db08-4419-a260-e12fc92dc487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:56.979392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0bfaf-db08-4419-a260-e12fc92dc487 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:56.979674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0bfaf-db08-4419-a260-e12fc92dc487 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:56.979953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0bfaf-db08-4419-a260-e12fc92dc487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:56.988237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0bfaf-db08-4419-a260-e12fc92dc487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:56.989891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0bfaf-db08-4419-a260-e12fc92dc487 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:56.999684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 716/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:57.928657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53cd36-c7ca-4916-bc20-356609fc7b6e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:57.929213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53cd36-c7ca-4916-bc20-356609fc7b6e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:57.929213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53cd36-c7ca-4916-bc20-356609fc7b6e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:57.930567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:57.936224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a200f-febb-495d-8db1-3b44c699b81b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:57.936621 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a200f-febb-495d-8db1-3b44c699b81b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:57.936779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a200f-febb-495d-8db1-3b44c699b81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:57.954231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-b96a200f-febb-495d-8db1-3b44c699b81b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:57.955453 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b96a200f-febb-495d-8db1-3b44c699b81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:57.963607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:58.113975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53cd36-c7ca-4916-bc20-356609fc7b6e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:58.127922 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53cd36-c7ca-4916-bc20-356609fc7b6e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:58.133263 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfc774-579f-4faa-9fb4-149bba3935c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:58.133894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfc774-579f-4faa-9fb4-149bba3935c2 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:58.134176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfc774-579f-4faa-9fb4-149bba3935c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:58.134456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfc774-579f-4faa-9fb4-149bba3935c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:58.142419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfc774-579f-4faa-9fb4-149bba3935c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:58.144066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfc774-579f-4faa-9fb4-149bba3935c2 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:58.153941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 711/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:19:59.130727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e13df-7e64-4f7e-bc8b-745383279409 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:59.131325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e13df-7e64-4f7e-bc8b-745383279409 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:59.131325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e13df-7e64-4f7e-bc8b-745383279409 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:59.132735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:19:59.138368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b8a21-7c5e-4128-80ee-3de7f0d7b6c8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:59.138797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b8a21-7c5e-4128-80ee-3de7f0d7b6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:59.138892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b8a21-7c5e-4128-80ee-3de7f0d7b6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:59.156221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-867b8a21-7c5e-4128-80ee-3de7f0d7b6c8 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:19:59.157396 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-867b8a21-7c5e-4128-80ee-3de7f0d7b6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:19:59.165009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:19:59.314314 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e13df-7e64-4f7e-bc8b-745383279409 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:19:59.328145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e13df-7e64-4f7e-bc8b-745383279409 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:19:59.333411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abc4d2-0ae2-4419-9012-17ea1434d3f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:19:59.334032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc4d2-0ae2-4419-9012-17ea1434d3f3 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:19:59.334317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc4d2-0ae2-4419-9012-17ea1434d3f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:19:59.334588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc4d2-0ae2-4419-9012-17ea1434d3f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:19:59.342583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abc4d2-0ae2-4419-9012-17ea1434d3f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:19:59.344195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abc4d2-0ae2-4419-9012-17ea1434d3f3 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:19:59.353708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 719/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:00.318459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb1f96-666f-4912-b8e3-7e970c201f87 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:00.318995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb1f96-666f-4912-b8e3-7e970c201f87 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:00.318995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb1f96-666f-4912-b8e3-7e970c201f87 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:00.320338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:20:00.326058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d218c-5c2e-4b47-b787-d3b107d4180b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:00.326533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d218c-5c2e-4b47-b787-d3b107d4180b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:00.326656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d218c-5c2e-4b47-b787-d3b107d4180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:00.344963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-db9d218c-5c2e-4b47-b787-d3b107d4180b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:00.346201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-db9d218c-5c2e-4b47-b787-d3b107d4180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:00.354500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:00.506624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb1f96-666f-4912-b8e3-7e970c201f87 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:00.520596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb1f96-666f-4912-b8e3-7e970c201f87 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:00.526522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302a59b-776e-4f77-90d3-a3afaa035dd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:00.527185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a59b-776e-4f77-90d3-a3afaa035dd5 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:00.527469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a59b-776e-4f77-90d3-a3afaa035dd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:00.527742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a59b-776e-4f77-90d3-a3afaa035dd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:00.536517 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302a59b-776e-4f77-90d3-a3afaa035dd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:00.538300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302a59b-776e-4f77-90d3-a3afaa035dd5 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:00.548950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 714/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:01.480291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9a145-dc06-4239-a5a1-3f3538c30924 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:01.480863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9a145-dc06-4239-a5a1-3f3538c30924 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:01.480863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9a145-dc06-4239-a5a1-3f3538c30924 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:01.482270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:20:01.487262 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d232b1-3376-4e36-9ebb-29224f12032f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:01.487653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d232b1-3376-4e36-9ebb-29224f12032f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:01.487822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d232b1-3376-4e36-9ebb-29224f12032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:01.505852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d8d232b1-3376-4e36-9ebb-29224f12032f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:01.507850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d8d232b1-3376-4e36-9ebb-29224f12032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:01.514854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:01.674767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9a145-dc06-4239-a5a1-3f3538c30924 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:01.689447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9a145-dc06-4239-a5a1-3f3538c30924 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:01.694869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c65b88-52cf-4f1c-8f1a-1e91cc7badb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:01.695540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c65b88-52cf-4f1c-8f1a-1e91cc7badb0 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:01.695830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c65b88-52cf-4f1c-8f1a-1e91cc7badb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:01.696113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c65b88-52cf-4f1c-8f1a-1e91cc7badb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:01.704081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c65b88-52cf-4f1c-8f1a-1e91cc7badb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:01.705680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c65b88-52cf-4f1c-8f1a-1e91cc7badb0 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:01.715116 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 722/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:02.637781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a52cd3-708c-4d36-82fd-9cba340ea6df None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:02.638350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a52cd3-708c-4d36-82fd-9cba340ea6df None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:02.638350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a52cd3-708c-4d36-82fd-9cba340ea6df None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:02.640521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:20:02.645666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20e48-9a61-4050-b1e5-5778f5728254 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:02.646072 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20e48-9a61-4050-b1e5-5778f5728254 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:02.646236 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20e48-9a61-4050-b1e5-5778f5728254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:02.664278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-4ad20e48-9a61-4050-b1e5-5778f5728254 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:02.665485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-4ad20e48-9a61-4050-b1e5-5778f5728254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:02.674078 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:20:02.821326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a52cd3-708c-4d36-82fd-9cba340ea6df None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:02.835239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a52cd3-708c-4d36-82fd-9cba340ea6df None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:02.841266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d415e-c9ba-4d74-b7e7-3fd1cf894664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:02.841885 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d415e-c9ba-4d74-b7e7-3fd1cf894664 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:02.842165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d415e-c9ba-4d74-b7e7-3fd1cf894664 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:02.842435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d415e-c9ba-4d74-b7e7-3fd1cf894664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:02.850156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d415e-c9ba-4d74-b7e7-3fd1cf894664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:02.851772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d415e-c9ba-4d74-b7e7-3fd1cf894664 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:02.861344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 717/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:04.962765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5464ec-499b-4771-bdcf-1f04f591d9ac None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:04.963345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5464ec-499b-4771-bdcf-1f04f591d9ac None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:04.963460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5464ec-499b-4771-bdcf-1f04f591d9ac None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:04.964758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:20:04.970121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde87c5-023a-46f1-818d-39f8d08a2f6a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:04.970558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde87c5-023a-46f1-818d-39f8d08a2f6a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:04.970686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde87c5-023a-46f1-818d-39f8d08a2f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:04.988030 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2dde87c5-023a-46f1-818d-39f8d08a2f6a None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:04.989350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2dde87c5-023a-46f1-818d-39f8d08a2f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:04.997713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:05.043022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5464ec-499b-4771-bdcf-1f04f591d9ac None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:05.053465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5464ec-499b-4771-bdcf-1f04f591d9ac None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:05.057481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5498ad-c329-4922-a986-df7470b36306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:05.058112 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5498ad-c329-4922-a986-df7470b36306 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:05.058393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5498ad-c329-4922-a986-df7470b36306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:05.058670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5498ad-c329-4922-a986-df7470b36306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:05.067197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5498ad-c329-4922-a986-df7470b36306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:05.068650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5498ad-c329-4922-a986-df7470b36306 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:05.078319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 725/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:07.463462 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75950e-22eb-42a1-b051-8e97463ca53f None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:07.464015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75950e-22eb-42a1-b051-8e97463ca53f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:07.464015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75950e-22eb-42a1-b051-8e97463ca53f None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:07.465394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:20:07.470672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0c8be-d53f-4789-92e3-caad41be356d None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:07.471090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0c8be-d53f-4789-92e3-caad41be356d None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:07.471259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0c8be-d53f-4789-92e3-caad41be356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:07.488574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e8d0c8be-d53f-4789-92e3-caad41be356d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:07.489752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e8d0c8be-d53f-4789-92e3-caad41be356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:07.497473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:07.534874 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75950e-22eb-42a1-b051-8e97463ca53f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:07.545326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75950e-22eb-42a1-b051-8e97463ca53f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:07.548883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abaec5-8e32-4874-87cc-058c340ac045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:07.549513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abaec5-8e32-4874-87cc-058c340ac045 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:07.549799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abaec5-8e32-4874-87cc-058c340ac045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:07.550079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abaec5-8e32-4874-87cc-058c340ac045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:07.558690 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abaec5-8e32-4874-87cc-058c340ac045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:07.560187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abaec5-8e32-4874-87cc-058c340ac045 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:07.569333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 720/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:10.180819 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c94ec-0c4c-47d3-a794-934a47bb3f29 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:10.181928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c94ec-0c4c-47d3-a794-934a47bb3f29 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:10.181928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c94ec-0c4c-47d3-a794-934a47bb3f29 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:10.183328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:20:10.188535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881f91-0e71-421c-972d-5291f1f6d014 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:10.188974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881f91-0e71-421c-972d-5291f1f6d014 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:10.189083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881f91-0e71-421c-972d-5291f1f6d014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:10.206881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-78881f91-0e71-421c-972d-5291f1f6d014 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:10.208118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-78881f91-0e71-421c-972d-5291f1f6d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:10.216104 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:10.253892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c94ec-0c4c-47d3-a794-934a47bb3f29 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:10.255613 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-1a3c94ec-0c4c-47d3-a794-934a47bb3f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:10.268640 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c94ec-0c4c-47d3-a794-934a47bb3f29 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:10.272114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33ea94-7a66-4aca-90d4-fb2b510cbdb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:10.272744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33ea94-7a66-4aca-90d4-fb2b510cbdb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:10.273028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33ea94-7a66-4aca-90d4-fb2b510cbdb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:10.273304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33ea94-7a66-4aca-90d4-fb2b510cbdb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:10.281842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33ea94-7a66-4aca-90d4-fb2b510cbdb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:10.283315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33ea94-7a66-4aca-90d4-fb2b510cbdb8 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:10.292334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 728/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:12.705427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712623d-72e1-4de4-9c5b-1096f3343253 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:12.705996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712623d-72e1-4de4-9c5b-1096f3343253 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:12.705996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712623d-72e1-4de4-9c5b-1096f3343253 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:12.707436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:20:12.712949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d929e7-bcfb-4d35-88c1-a7ccfcece8f6 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:12.713374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d929e7-bcfb-4d35-88c1-a7ccfcece8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:12.713515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d929e7-bcfb-4d35-88c1-a7ccfcece8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:12.731301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-60d929e7-bcfb-4d35-88c1-a7ccfcece8f6 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:12.732504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-60d929e7-bcfb-4d35-88c1-a7ccfcece8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:12.740235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:12.777606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712623d-72e1-4de4-9c5b-1096f3343253 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:12.788151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712623d-72e1-4de4-9c5b-1096f3343253 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:12.792177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af7f42-9ff9-4a28-9538-b9b964ec0631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:12.792811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af7f42-9ff9-4a28-9538-b9b964ec0631 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:12.793091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af7f42-9ff9-4a28-9538-b9b964ec0631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:12.793364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af7f42-9ff9-4a28-9538-b9b964ec0631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:12.802120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af7f42-9ff9-4a28-9538-b9b964ec0631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:12.803616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af7f42-9ff9-4a28-9538-b9b964ec0631 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:12.813312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 723/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:15.091517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e40db-0ec1-48f3-a506-e3b0d8380c3c None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:15.092066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e40db-0ec1-48f3-a506-e3b0d8380c3c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:15.092066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e40db-0ec1-48f3-a506-e3b0d8380c3c None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:15.093476 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:20:15.098826 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342338-992f-4ce7-a003-c608ca2ec122 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:15.099298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342338-992f-4ce7-a003-c608ca2ec122 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:15.099429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342338-992f-4ce7-a003-c608ca2ec122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:15.117297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2f342338-992f-4ce7-a003-c608ca2ec122 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:15.118491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2f342338-992f-4ce7-a003-c608ca2ec122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:15.131473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:15.168536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e40db-0ec1-48f3-a506-e3b0d8380c3c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:15.179001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e40db-0ec1-48f3-a506-e3b0d8380c3c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:15.183023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da734b1-2b53-4be6-8388-bd7bcb4a8ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:15.183695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da734b1-2b53-4be6-8388-bd7bcb4a8ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:15.183979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da734b1-2b53-4be6-8388-bd7bcb4a8ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:15.184257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da734b1-2b53-4be6-8388-bd7bcb4a8ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:15.192833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da734b1-2b53-4be6-8388-bd7bcb4a8ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:15.194287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da734b1-2b53-4be6-8388-bd7bcb4a8ca0 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:15.203459 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 731/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:17.468395 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b92ca-1c97-4b9d-85a4-1e362f8e4073 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:17.468970 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b92ca-1c97-4b9d-85a4-1e362f8e4073 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:17.468970 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b92ca-1c97-4b9d-85a4-1e362f8e4073 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:17.470290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:20:17.475738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378c48-8bdf-484e-8e31-1b39cb8c07c1 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:17.476166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378c48-8bdf-484e-8e31-1b39cb8c07c1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:17.476390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62378c48-8bdf-484e-8e31-1b39cb8c07c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:17.494580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-62378c48-8bdf-484e-8e31-1b39cb8c07c1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:17.495797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-62378c48-8bdf-484e-8e31-1b39cb8c07c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:17.504044 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:17.542085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b92ca-1c97-4b9d-85a4-1e362f8e4073 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:17.552571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b92ca-1c97-4b9d-85a4-1e362f8e4073 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:17.556141 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df22e8-9648-441c-88bf-d400e40c386b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:17.556721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df22e8-9648-441c-88bf-d400e40c386b service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:17.557010 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df22e8-9648-441c-88bf-d400e40c386b service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:17.557288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df22e8-9648-441c-88bf-d400e40c386b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:17.565951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df22e8-9648-441c-88bf-d400e40c386b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:17.567443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df22e8-9648-441c-88bf-d400e40c386b service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:17.576583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 726/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:19.872005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6174a-ca55-405c-8b1a-a0ab6c93ca86 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:19.872551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6174a-ca55-405c-8b1a-a0ab6c93ca86 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:19.872551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6174a-ca55-405c-8b1a-a0ab6c93ca86 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:19.873962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:20:19.879309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67cce3-e287-43a5-b35e-c5468e8d4704 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:19.880065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67cce3-e287-43a5-b35e-c5468e8d4704 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:19.880065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67cce3-e287-43a5-b35e-c5468e8d4704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:19.898839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2d67cce3-e287-43a5-b35e-c5468e8d4704 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:19.900138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2d67cce3-e287-43a5-b35e-c5468e8d4704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:19.908047 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:19.945082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6174a-ca55-405c-8b1a-a0ab6c93ca86 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:19.955990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6174a-ca55-405c-8b1a-a0ab6c93ca86 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:19.959778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c7d42-468b-4464-b262-727568c06633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:19.960449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7d42-468b-4464-b262-727568c06633 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:19.960731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7d42-468b-4464-b262-727568c06633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:19.961003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7d42-468b-4464-b262-727568c06633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:19.970250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c7d42-468b-4464-b262-727568c06633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:19.971721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c7d42-468b-4464-b262-727568c06633 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:19.980718 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 734/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:22.236851 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceef76-8a3c-446a-86ce-0125b6ae81e6 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:22.237388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceef76-8a3c-446a-86ce-0125b6ae81e6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:22.237484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceef76-8a3c-446a-86ce-0125b6ae81e6 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:22.238849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:20:22.244196 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dacbb3-bca4-452c-bf89-5ee13e89d0dd None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:22.244657 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dacbb3-bca4-452c-bf89-5ee13e89d0dd None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:22.244757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dacbb3-bca4-452c-bf89-5ee13e89d0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:22.261897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f7dacbb3-bca4-452c-bf89-5ee13e89d0dd None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:22.263089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f7dacbb3-bca4-452c-bf89-5ee13e89d0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:22.270869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:22.307920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cceef76-8a3c-446a-86ce-0125b6ae81e6 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:22.318226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cceef76-8a3c-446a-86ce-0125b6ae81e6 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:22.321669 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c08df1-702d-4971-854a-57e11549e0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:22.322285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08df1-702d-4971-854a-57e11549e0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:22.322562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08df1-702d-4971-854a-57e11549e0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:22.322830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08df1-702d-4971-854a-57e11549e0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:22.331512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c08df1-702d-4971-854a-57e11549e0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:22.332979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c08df1-702d-4971-854a-57e11549e0e6 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:22.343095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 729/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:24.636069 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053b314-623e-4feb-b27b-aead778ec481 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:24.636634 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053b314-623e-4feb-b27b-aead778ec481 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:24.636634 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053b314-623e-4feb-b27b-aead778ec481 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:24.638021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:20:24.643308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0bb1-a0eb-4ad2-9b0c-d7a684cc01b4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:24.643742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0bb1-a0eb-4ad2-9b0c-d7a684cc01b4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:24.643876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0bb1-a0eb-4ad2-9b0c-d7a684cc01b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:24.661156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-fa2b0bb1-a0eb-4ad2-9b0c-d7a684cc01b4 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:24.662357 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fa2b0bb1-a0eb-4ad2-9b0c-d7a684cc01b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:24.670624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:24.706358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053b314-623e-4feb-b27b-aead778ec481 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:24.717098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053b314-623e-4feb-b27b-aead778ec481 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:24.720583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0718c-cd0a-431e-8327-5a4226759f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:24.721211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0718c-cd0a-431e-8327-5a4226759f3c service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:24.721495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0718c-cd0a-431e-8327-5a4226759f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:24.721769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0718c-cd0a-431e-8327-5a4226759f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:24.731016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0718c-cd0a-431e-8327-5a4226759f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:24.732501 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0718c-cd0a-431e-8327-5a4226759f3c service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:24.741693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 737/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:20:26.956160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2982ce-9d88-4300-ad1a-32fdeb1cd6e1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:26.956729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2982ce-9d88-4300-ad1a-32fdeb1cd6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:26.956729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2982ce-9d88-4300-ad1a-32fdeb1cd6e1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:26.958067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:20:26.963800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c8649-accf-4f7c-bae1-c11c3bbd83a8 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:26.964235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c8649-accf-4f7c-bae1-c11c3bbd83a8 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:26.964368 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c8649-accf-4f7c-bae1-c11c3bbd83a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:26.982835 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-143c8649-accf-4f7c-bae1-c11c3bbd83a8 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:20:26.984457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-143c8649-accf-4f7c-bae1-c11c3bbd83a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:20:26.992506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:20:27.028538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2982ce-9d88-4300-ad1a-32fdeb1cd6e1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:20:27.038933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2982ce-9d88-4300-ad1a-32fdeb1cd6e1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:20:27.042916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93043ac5-42c1-4537-a3e6-62963942dbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:20:27.043580 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93043ac5-42c1-4537-a3e6-62963942dbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:20:27.043865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93043ac5-42c1-4537-a3e6-62963942dbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:20:27.044145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93043ac5-42c1-4537-a3e6-62963942dbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:20:27.052729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93043ac5-42c1-4537-a3e6-62963942dbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:20:27.054187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93043ac5-42c1-4537-a3e6-62963942dbf2 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:20:27.063976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 732/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:21:00.396656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463314b4-cbd5-4961-a38b-b5f1564615db None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:00.397276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463314b4-cbd5-4961-a38b-b5f1564615db None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:00.397276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463314b4-cbd5-4961-a38b-b5f1564615db None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:00.398693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 739/1471] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:21:00.404060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4f03e-81ec-44ea-8b6e-4d941feea467 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:00.404498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4f03e-81ec-44ea-8b6e-4d941feea467 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:00.404607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4f03e-81ec-44ea-8b6e-4d941feea467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:00.421999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7ed4f03e-81ec-44ea-8b6e-4d941feea467 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:21:00.423262 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7ed4f03e-81ec-44ea-8b6e-4d941feea467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:21:00.431456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 733/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:21:00.478841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b6e1e-94c0-435f-b1cf-bc109540b6c1 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:00.478841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b6e1e-94c0-435f-b1cf-bc109540b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:00.478841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b6e1e-94c0-435f-b1cf-bc109540b6c1 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:00.480195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 740/1473] 10.222.0.64 () {54 vars in 962 bytes} [Fri May 13 17:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:21:00.484995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99428d-7387-4d95-9d92-71e88960a377 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:00.485289 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99428d-7387-4d95-9d92-71e88960a377 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:00.485573 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99428d-7387-4d95-9d92-71e88960a377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:00.504040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-dd99428d-7387-4d95-9d92-71e88960a377 None None] MFA Rules not processed for user `8e00de466abe41da8e6d7dbbd71f5270`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:21:00.505242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dd99428d-7387-4d95-9d92-71e88960a377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:21:00.512423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 734/1474] 10.222.0.64 () {58 vars in 1059 bytes} [Fri May 13 17:21:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:21:00.519551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b6e1e-94c0-435f-b1cf-bc109540b6c1 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:21:00.530549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b6e1e-94c0-435f-b1cf-bc109540b6c1 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:21:00.534104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a31768-2ee0-4679-8f8b-fddfea836efb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e00de466abe41da8e6d7dbbd71f5270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:21:00.534728 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a31768-2ee0-4679-8f8b-fddfea836efb service glance] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:00.535007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a31768-2ee0-4679-8f8b-fddfea836efb service glance] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:00.535310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a31768-2ee0-4679-8f8b-fddfea836efb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:00.544600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a31768-2ee0-4679-8f8b-fddfea836efb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:21:00.546135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a31768-2ee0-4679-8f8b-fddfea836efb service glance] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:21:00.555429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 741/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:21:02.859290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f868d6-e35d-4f12-9fd6-1002b559e55d None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:02.859870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f868d6-e35d-4f12-9fd6-1002b559e55d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:02.859870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f868d6-e35d-4f12-9fd6-1002b559e55d None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:02.861257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 735/1476] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:21:02.866541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a6fe7-1406-4498-90ed-00338bf355ec None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:02.866962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a6fe7-1406-4498-90ed-00338bf355ec None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:02.867104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a6fe7-1406-4498-90ed-00338bf355ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:02.884992 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-b08a6fe7-1406-4498-90ed-00338bf355ec None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:21:02.886194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b08a6fe7-1406-4498-90ed-00338bf355ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:21:02.893966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 742/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:21:02.916673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f868d6-e35d-4f12-9fd6-1002b559e55d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:21:02.928936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f868d6-e35d-4f12-9fd6-1002b559e55d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:21:02.933459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0b1ef-a92e-4852-a77f-7675763f9283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:21:02.934095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0b1ef-a92e-4852-a77f-7675763f9283 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:02.934379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0b1ef-a92e-4852-a77f-7675763f9283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:02.934651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0b1ef-a92e-4852-a77f-7675763f9283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:02.935419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0b1ef-a92e-4852-a77f-7675763f9283 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:21:02.937205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-d1e0b1ef-a92e-4852-a77f-7675763f9283 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 17:21:02.937205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: warnings.warn(msg) May 13 17:21:02.937205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: May 13 17:21:02.938337 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0b1ef-a92e-4852-a77f-7675763f9283 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:21:02.957434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 736/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Fri May 13 17:21:02 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:21:05.183988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6161b4b-86fd-4de3-b952-685ae434dbcc None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:05.184540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6161b4b-86fd-4de3-b952-685ae434dbcc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:05.184659 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6161b4b-86fd-4de3-b952-685ae434dbcc None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:05.185957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 743/1479] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:21:05.191272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a7b59-9953-473d-9113-25e6b2b024ee None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:05.191706 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a7b59-9953-473d-9113-25e6b2b024ee None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:05.191814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a7b59-9953-473d-9113-25e6b2b024ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:05.209019 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-770a7b59-9953-473d-9113-25e6b2b024ee None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:21:05.210194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-770a7b59-9953-473d-9113-25e6b2b024ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:21:05.218072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 737/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:21:05.260137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6161b4b-86fd-4de3-b952-685ae434dbcc None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:21:05.274108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6161b4b-86fd-4de3-b952-685ae434dbcc None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:21:05.283021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f17096-3658-48df-b214-5d018179c1bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:21:05.283712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17096-3658-48df-b214-5d018179c1bd service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:05.283998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17096-3658-48df-b214-5d018179c1bd service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:05.284272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17096-3658-48df-b214-5d018179c1bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:05.292887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f17096-3658-48df-b214-5d018179c1bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:21:05.294473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f17096-3658-48df-b214-5d018179c1bd service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:21:05.303583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 744/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:21:07.723582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7c5a-47cb-4855-9be0-15a0cd9141d7 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:07.724136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7c5a-47cb-4855-9be0-15a0cd9141d7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:07.724136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7c5a-47cb-4855-9be0-15a0cd9141d7 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:07.725421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 738/1482] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:21:07.734005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a96d-acbb-401c-ad49-174f4ef74c2c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:07.734480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a96d-acbb-401c-ad49-174f4ef74c2c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:07.735400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a96d-acbb-401c-ad49-174f4ef74c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:07.753033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-54e7a96d-acbb-401c-ad49-174f4ef74c2c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:21:07.754231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-54e7a96d-acbb-401c-ad49-174f4ef74c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:21:07.762339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 745/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:21:07.799466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f7c5a-47cb-4855-9be0-15a0cd9141d7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:21:07.810327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f7c5a-47cb-4855-9be0-15a0cd9141d7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:21:07.813845 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361106d-cc27-4be5-a1f9-83f12f56dab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:21:07.814482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361106d-cc27-4be5-a1f9-83f12f56dab6 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:07.814767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361106d-cc27-4be5-a1f9-83f12f56dab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:07.815047 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361106d-cc27-4be5-a1f9-83f12f56dab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:07.824249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361106d-cc27-4be5-a1f9-83f12f56dab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:21:07.825714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361106d-cc27-4be5-a1f9-83f12f56dab6 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:21:07.834869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 739/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:21:10.088294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f232-4488-4dbe-9745-b272159020fa None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:10.088845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f232-4488-4dbe-9745-b272159020fa None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:10.088845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f232-4488-4dbe-9745-b272159020fa None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:10.090235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 746/1485] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:21:10.095755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbab6d-51d9-4a28-8ff2-d202492c59c4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:10.096503 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbab6d-51d9-4a28-8ff2-d202492c59c4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:10.096503 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbab6d-51d9-4a28-8ff2-d202492c59c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:10.115622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0ebbab6d-51d9-4a28-8ff2-d202492c59c4 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:21:10.116817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0ebbab6d-51d9-4a28-8ff2-d202492c59c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:21:10.125464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 740/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:21:10.173872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2f232-4488-4dbe-9745-b272159020fa None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:21:10.185085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2f232-4488-4dbe-9745-b272159020fa None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:21:10.188676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b162f8-1173-4b74-a407-21376828d563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:21:10.189314 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b162f8-1173-4b74-a407-21376828d563 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:10.189591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b162f8-1173-4b74-a407-21376828d563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:10.189860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b162f8-1173-4b74-a407-21376828d563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:10.200931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b162f8-1173-4b74-a407-21376828d563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:21:10.203523 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b162f8-1173-4b74-a407-21376828d563 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:21:10.212311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 747/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:21:12.541489 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dafa2-1b60-41fd-9576-39cdb4866060 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:12.542035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dafa2-1b60-41fd-9576-39cdb4866060 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:12.542035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dafa2-1b60-41fd-9576-39cdb4866060 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:12.543416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 741/1488] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:21:12.548509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027bed-453b-4201-b660-508be786f7bd None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:12.548913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027bed-453b-4201-b660-508be786f7bd None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:12.549065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027bed-453b-4201-b660-508be786f7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:12.566734 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-27027bed-453b-4201-b660-508be786f7bd None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:21:12.567964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-27027bed-453b-4201-b660-508be786f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:21:12.576290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 748/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:21:12.615935 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dafa2-1b60-41fd-9576-39cdb4866060 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:21:12.626720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dafa2-1b60-41fd-9576-39cdb4866060 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:21:12.630164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a7f7e-902a-4c1d-967a-dd56c0c1e8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:21:12.630782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a7f7e-902a-4c1d-967a-dd56c0c1e8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:12.631059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a7f7e-902a-4c1d-967a-dd56c0c1e8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:12.631360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a7f7e-902a-4c1d-967a-dd56c0c1e8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:12.640480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a7f7e-902a-4c1d-967a-dd56c0c1e8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:21:12.641913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a7f7e-902a-4c1d-967a-dd56c0c1e8b7 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:21:12.651064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 742/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:21:15.277976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f99648-c574-477f-8cf0-916f9a3951ac None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:15.278520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f99648-c574-477f-8cf0-916f9a3951ac None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:15.278520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f99648-c574-477f-8cf0-916f9a3951ac None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:15.279919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 749/1491] 10.222.0.64 () {54 vars in 926 bytes} [Fri May 13 17:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:21:15.285204 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a07908-1f7c-4483-b88e-7dc30193e0aa None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:15.285606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a07908-1f7c-4483-b88e-7dc30193e0aa None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:15.285785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a07908-1f7c-4483-b88e-7dc30193e0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:15.303624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-44a07908-1f7c-4483-b88e-7dc30193e0aa None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:21:15.304812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-44a07908-1f7c-4483-b88e-7dc30193e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:21:15.312383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 743/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Fri May 13 17:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:21:15.350071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f99648-c574-477f-8cf0-916f9a3951ac None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:21:15.361108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f99648-c574-477f-8cf0-916f9a3951ac None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:21:15.364590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55e9f5-9076-4b9d-b0e5-5408611b81c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:21:15.365220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55e9f5-9076-4b9d-b0e5-5408611b81c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:21:15.365507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55e9f5-9076-4b9d-b0e5-5408611b81c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:21:15.365789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55e9f5-9076-4b9d-b0e5-5408611b81c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:21:15.374407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55e9f5-9076-4b9d-b0e5-5408611b81c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:21:15.375884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55e9f5-9076-4b9d-b0e5-5408611b81c0 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:21:15.385120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 750/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:22:51.831224 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55207b36-8151-42bd-9286-a45ce18ad612 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:51.831784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55207b36-8151-42bd-9286-a45ce18ad612 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:51.831784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55207b36-8151-42bd-9286-a45ce18ad612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:51.849933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-55207b36-8151-42bd-9286-a45ce18ad612 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:22:51.851114 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-55207b36-8151-42bd-9286-a45ce18ad612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:22:51.859034 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 744/1494] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:22:51.868230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183006de-dd22-4cd1-bd37-ff1e5c9b8739 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:51.868733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183006de-dd22-4cd1-bd37-ff1e5c9b8739 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:51.868847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183006de-dd22-4cd1-bd37-ff1e5c9b8739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:51.886193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-183006de-dd22-4cd1-bd37-ff1e5c9b8739 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:22:51.887943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-183006de-dd22-4cd1-bd37-ff1e5c9b8739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:22:51.895518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 751/1495] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:22:51.899888 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55207b36-8151-42bd-9286-a45ce18ad612 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:22:51.909988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55207b36-8151-42bd-9286-a45ce18ad612 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:22:51.914474 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302a8a8-05fb-4204-931a-8ef9b38c4237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:22:51.915112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302a8a8-05fb-4204-931a-8ef9b38c4237 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:51.915421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302a8a8-05fb-4204-931a-8ef9b38c4237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:51.915711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302a8a8-05fb-4204-931a-8ef9b38c4237 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:51.916420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302a8a8-05fb-4204-931a-8ef9b38c4237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:22:51.916748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302a8a8-05fb-4204-931a-8ef9b38c4237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:22:51.917778 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-e302a8a8-05fb-4204-931a-8ef9b38c4237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:22:51.917778 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: warnings.warn(msg) May 13 17:22:51.917778 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: May 13 17:22:51.918659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302a8a8-05fb-4204-931a-8ef9b38c4237 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:22:51.929736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 745/1496] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:22:51.938125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183006de-dd22-4cd1-bd37-ff1e5c9b8739 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:22:51.946831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183006de-dd22-4cd1-bd37-ff1e5c9b8739 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:22:51.951929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe94e09-5b31-4e11-94cb-ed55e328d614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:22:51.952562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe94e09-5b31-4e11-94cb-ed55e328d614 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:51.952845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe94e09-5b31-4e11-94cb-ed55e328d614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:51.953120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe94e09-5b31-4e11-94cb-ed55e328d614 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:51.953799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe94e09-5b31-4e11-94cb-ed55e328d614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:22:51.955593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: WARNING py.warnings [None req-bfe94e09-5b31-4e11-94cb-ed55e328d614 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 17:22:51.955593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: warnings.warn(msg) May 13 17:22:51.955593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: May 13 17:22:51.956785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe94e09-5b31-4e11-94cb-ed55e328d614 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:22:52.068255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 752/1497] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:22:51 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:22:52.072490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302a8a8-05fb-4204-931a-8ef9b38c4237 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:22:52.083165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302a8a8-05fb-4204-931a-8ef9b38c4237 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:22:52.137280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66b6ae-c20a-4787-a2a9-517813090414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:22:52.138600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66b6ae-c20a-4787-a2a9-517813090414 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:52.138900 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66b6ae-c20a-4787-a2a9-517813090414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:52.139179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66b6ae-c20a-4787-a2a9-517813090414 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:52.139881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66b6ae-c20a-4787-a2a9-517813090414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:22:52.140917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-eb66b6ae-c20a-4787-a2a9-517813090414 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 17:22:52.140917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: warnings.warn(msg) May 13 17:22:52.140917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: May 13 17:22:52.142121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66b6ae-c20a-4787-a2a9-517813090414 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:22:52.221235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 746/1498] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:22:52 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:22:52.225325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe94e09-5b31-4e11-94cb-ed55e328d614 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:22:52.236057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe94e09-5b31-4e11-94cb-ed55e328d614 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:22:52.240586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bfc6c-57c2-4780-a26d-a8405bb89f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:22:52.241245 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bfc6c-57c2-4780-a26d-a8405bb89f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:52.241534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bfc6c-57c2-4780-a26d-a8405bb89f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:52.241815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bfc6c-57c2-4780-a26d-a8405bb89f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:52.242541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bfc6c-57c2-4780-a26d-a8405bb89f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:22:52.243596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: WARNING py.warnings [None req-e71bfc6c-57c2-4780-a26d-a8405bb89f8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:22:52.243596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: warnings.warn(msg) May 13 17:22:52.243596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: May 13 17:22:52.244479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bfc6c-57c2-4780-a26d-a8405bb89f8b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:22:52.257418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 753/1499] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:22:52.261256 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66b6ae-c20a-4787-a2a9-517813090414 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:22:52.271479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66b6ae-c20a-4787-a2a9-517813090414 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:22:52.275992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b73ea5-55f3-4c7b-943f-3d64e7ab7ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:22:52.276641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73ea5-55f3-4c7b-943f-3d64e7ab7ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:52.276927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73ea5-55f3-4c7b-943f-3d64e7ab7ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:52.277206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b73ea5-55f3-4c7b-943f-3d64e7ab7ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:52.277924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b73ea5-55f3-4c7b-943f-3d64e7ab7ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:22:52.278954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-b1b73ea5-55f3-4c7b-943f-3d64e7ab7ee1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:22:52.278954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: warnings.warn(msg) May 13 17:22:52.278954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: May 13 17:22:52.279887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b73ea5-55f3-4c7b-943f-3d64e7ab7ee1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:22:52.292782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 747/1500] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:22:52.297310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bfc6c-57c2-4780-a26d-a8405bb89f8b admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:22:52.306825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bfc6c-57c2-4780-a26d-a8405bb89f8b admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:22:52.311917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e6d03-3fbb-4247-9ef6-8a335d4c360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:22:52.312785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6d03-3fbb-4247-9ef6-8a335d4c360a admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:52.313065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6d03-3fbb-4247-9ef6-8a335d4c360a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:52.313339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6d03-3fbb-4247-9ef6-8a335d4c360a admin admin] PATH_INFO: `/v3/projects/45163c8f002446dbb5fe8bfdc6af1599/users/6f7e91ddf4504293b8f791cbe1f4da71/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:52.327390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e6d03-3fbb-4247-9ef6-8a335d4c360a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45163c8f002446dbb5fe8bfdc6af1599, user_id=6f7e91ddf4504293b8f791cbe1f4da71, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:22:52.328417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: WARNING py.warnings [None req-6f2e6d03-3fbb-4247-9ef6-8a335d4c360a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 17:22:52.328417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: warnings.warn(msg) May 13 17:22:52.328417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: May 13 17:22:52.330373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e6d03-3fbb-4247-9ef6-8a335d4c360a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:22:52.438373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 754/1501] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:22:52 2022] PUT /identity/v3/projects/45163c8f002446dbb5fe8bfdc6af1599/users/6f7e91ddf4504293b8f791cbe1f4da71/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:22:52.449711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff32ed-4d27-4db0-9050-5f4bc4a61db8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:52.450928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff32ed-4d27-4db0-9050-5f4bc4a61db8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:52.451259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff32ed-4d27-4db0-9050-5f4bc4a61db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:52.478591 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f7ff32ed-4d27-4db0-9050-5f4bc4a61db8 None None] MFA Rules not processed for user `6f7e91ddf4504293b8f791cbe1f4da71`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:22:52.480062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f7ff32ed-4d27-4db0-9050-5f4bc4a61db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:22:52.548173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 748/1502] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:22:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:22:52.562045 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821ebea-3c1d-47dd-8ce3-3ca7c6c09667 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:52.562401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821ebea-3c1d-47dd-8ce3-3ca7c6c09667 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:52.562683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821ebea-3c1d-47dd-8ce3-3ca7c6c09667 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:52.564136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 755/1503] 10.222.0.64 () {54 vars in 963 bytes} [Fri May 13 17:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:22:52.569203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dfffa-b86a-4c48-9020-4ee42c7c70e8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:52.569502 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dfffa-b86a-4c48-9020-4ee42c7c70e8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:52.569782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dfffa-b86a-4c48-9020-4ee42c7c70e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:52.587373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-df4dfffa-b86a-4c48-9020-4ee42c7c70e8 None None] MFA Rules not processed for user `cd116be69d7f4cffb770940ccb7514fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:22:52.588850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-df4dfffa-b86a-4c48-9020-4ee42c7c70e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:22:52.643247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 749/1504] 10.222.0.64 () {58 vars in 1060 bytes} [Fri May 13 17:22:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:22:52.650561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821ebea-3c1d-47dd-8ce3-3ca7c6c09667 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:22:52.661455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821ebea-3c1d-47dd-8ce3-3ca7c6c09667 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:22:52.664997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cab1f0-e8ec-4a1b-a11c-f44087111498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:22:52.665628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab1f0-e8ec-4a1b-a11c-f44087111498 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:52.665911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab1f0-e8ec-4a1b-a11c-f44087111498 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:52.666190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab1f0-e8ec-4a1b-a11c-f44087111498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:52.674915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cab1f0-e8ec-4a1b-a11c-f44087111498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:22:52.676396 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cab1f0-e8ec-4a1b-a11c-f44087111498 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:22:52.684911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 756/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:22:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:22:52.726138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f579022-e09a-458b-8053-1cdc2375d6c1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:52.726438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f579022-e09a-458b-8053-1cdc2375d6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:52.726720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f579022-e09a-458b-8053-1cdc2375d6c1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:52.728048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 750/1506] 10.222.0.64 () {52 vars in 829 bytes} [Fri May 13 17:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:22:52.732262 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cab1f0-e8ec-4a1b-a11c-f44087111498 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:22:52.790713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cab1f0-e8ec-4a1b-a11c-f44087111498 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:22:52.801155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:22:52.801155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:52.801155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:52.801155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] PATH_INFO: `/v3/users/6f7e91ddf4504293b8f791cbe1f4da71` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:52.801583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7e91ddf4504293b8f791cbe1f4da71)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:22:52.801583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: WARNING py.warnings [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 17:22:52.801583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: warnings.warn(msg) May 13 17:22:52.801583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: May 13 17:22:52.801583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:22:53.022108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7e91ddf4504293b8f791cbe1f4da71'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:22:53.040217 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7e91ddf4504293b8f791cbe1f4da71'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:22:53.040987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7e91ddf4504293b8f791cbe1f4da71'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:22:53.140822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7e91ddf4504293b8f791cbe1f4da71'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:22:53.153921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7e91ddf4504293b8f791cbe1f4da71'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:22:53.159958 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 757/1507] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:22:52 2022] DELETE /identity/v3/users/6f7e91ddf4504293b8f791cbe1f4da71 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:22:53.164383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aba20-1847-480e-9ffa-dce810e19077 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:53.164864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aba20-1847-480e-9ffa-dce810e19077 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:53.164973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aba20-1847-480e-9ffa-dce810e19077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:53.181873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7e6aba20-1847-480e-9ffa-dce810e19077 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:22:53.183071 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7e6aba20-1847-480e-9ffa-dce810e19077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:22:53.239543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 751/1508] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:22:53.248900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:22:53.250347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:22:53.306302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e111a1-86e1-4e68-aaa4-3527d95b9622 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:22:53.309833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5643-72d5-49d1-a8ec-801260afa589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:22:53.310467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5643-72d5-49d1-a8ec-801260afa589 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:53.310748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5643-72d5-49d1-a8ec-801260afa589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:53.311017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5643-72d5-49d1-a8ec-801260afa589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:53.319602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5643-72d5-49d1-a8ec-801260afa589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:22:53.321038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5643-72d5-49d1-a8ec-801260afa589 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:22:53.330575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 758/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:22:53.816983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6aba20-1847-480e-9ffa-dce810e19077 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:22:53.818423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7e6aba20-1847-480e-9ffa-dce810e19077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:22:53.836787 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6aba20-1847-480e-9ffa-dce810e19077 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:22:53.836787 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:22:53.837812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:22:53.838111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:22:53.838375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] PATH_INFO: `/v3/projects/45163c8f002446dbb5fe8bfdc6af1599` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:22:53.839892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] RBAC: Authorizing `identity:delete_project(project_id=45163c8f002446dbb5fe8bfdc6af1599)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:22:53.840899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 17:22:53.840899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: warnings.warn(msg) May 13 17:22:53.840899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: May 13 17:22:53.843148 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:22:53.981186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45163c8f002446dbb5fe8bfdc6af1599', 'request_id': 'req-42844e7a-b958-4778-8e73-7ed6cf4f93df'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:22:53.987540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45163c8f002446dbb5fe8bfdc6af1599', 'request_id': 'req-42844e7a-b958-4778-8e73-7ed6cf4f93df'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:22:54.306799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45163c8f002446dbb5fe8bfdc6af1599', 'request_id': 'req-42844e7a-b958-4778-8e73-7ed6cf4f93df'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:22:54.326758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] The token cache is being invalidate because project 45163c8f002446dbb5fe8bfdc6af1599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:22:54.327047 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:22:54.327711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-42844e7a-b958-4778-8e73-7ed6cf4f93df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:22:54.329364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 752/1510] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:22:53 2022] DELETE /identity/v3/projects/45163c8f002446dbb5fe8bfdc6af1599 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:24:36.772383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519c4f-feb7-4450-aca2-f937dc0ba669 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:36.772977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519c4f-feb7-4450-aca2-f937dc0ba669 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:36.772977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519c4f-feb7-4450-aca2-f937dc0ba669 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:36.774365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:24:36.780406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce902e-a1e7-4795-9368-47eb30c5a1bb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:36.780835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce902e-a1e7-4795-9368-47eb30c5a1bb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:36.781030 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce902e-a1e7-4795-9368-47eb30c5a1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:36.799819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7bce902e-a1e7-4795-9368-47eb30c5a1bb None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:24:36.801033 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7bce902e-a1e7-4795-9368-47eb30c5a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:24:36.857383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:24:37.023666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519c4f-feb7-4450-aca2-f937dc0ba669 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:24:37.025287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-69519c4f-feb7-4450-aca2-f937dc0ba669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:24:37.096748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519c4f-feb7-4450-aca2-f937dc0ba669 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:24:37.102135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055b38a-7167-46bf-b91b-4b73a66120db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:24:37.102779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b38a-7167-46bf-b91b-4b73a66120db service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:37.103065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b38a-7167-46bf-b91b-4b73a66120db service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:37.103388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b38a-7167-46bf-b91b-4b73a66120db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:37.111972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055b38a-7167-46bf-b91b-4b73a66120db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:24:37.113591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055b38a-7167-46bf-b91b-4b73a66120db service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:24:37.123194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 760/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:24:38.021097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796af8b-bb0c-4ee8-8d40-21a201bf97d1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:38.021629 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796af8b-bb0c-4ee8-8d40-21a201bf97d1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:38.021756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796af8b-bb0c-4ee8-8d40-21a201bf97d1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:38.023057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:24:38.028005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3afa1b-152d-4d5e-bc94-5bcde825be63 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:38.028425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3afa1b-152d-4d5e-bc94-5bcde825be63 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:38.028565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3afa1b-152d-4d5e-bc94-5bcde825be63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:38.046735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-fd3afa1b-152d-4d5e-bc94-5bcde825be63 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:24:38.047967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fd3afa1b-152d-4d5e-bc94-5bcde825be63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:24:38.055542 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:24:38.205019 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796af8b-bb0c-4ee8-8d40-21a201bf97d1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:24:38.221679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796af8b-bb0c-4ee8-8d40-21a201bf97d1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:24:38.227353 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81164add-c8f6-4433-9022-960e199b09d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:24:38.228000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164add-c8f6-4433-9022-960e199b09d3 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:38.228289 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164add-c8f6-4433-9022-960e199b09d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:38.228663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164add-c8f6-4433-9022-960e199b09d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:38.237217 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81164add-c8f6-4433-9022-960e199b09d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:24:38.238849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81164add-c8f6-4433-9022-960e199b09d3 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:24:38.248214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 755/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:24:38.258580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a93c-3b04-48f4-8dbf-0b4bc1ded3e3 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:38.258873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a93c-3b04-48f4-8dbf-0b4bc1ded3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:38.259187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a93c-3b04-48f4-8dbf-0b4bc1ded3e3 None None] PATH_INFO: `/v3` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:38.260695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 762/1517] 10.222.0.82 () {54 vars in 925 bytes} [Fri May 13 17:24:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:24:38.267468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2b123-1cbf-46d2-8896-a6f26cf119f4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:38.267776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2b123-1cbf-46d2-8896-a6f26cf119f4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:38.268072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2b123-1cbf-46d2-8896-a6f26cf119f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:38.285735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-82f2b123-1cbf-46d2-8896-a6f26cf119f4 None None] MFA Rules not processed for user `b84ae21424694df68a96b928e15e9240`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:24:38.286987 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-82f2b123-1cbf-46d2-8896-a6f26cf119f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:24:38.351341 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 756/1518] 10.222.0.82 () {58 vars in 1015 bytes} [Fri May 13 17:24:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:24:47.842320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92af5e-d81a-4fa7-9f47-f6dd6e6ebf76 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:47.842849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92af5e-d81a-4fa7-9f47-f6dd6e6ebf76 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:47.842849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92af5e-d81a-4fa7-9f47-f6dd6e6ebf76 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:47.844314 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 763/1519] 10.222.0.64 () {54 vars in 960 bytes} [Fri May 13 17:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:24:47.849168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552400-0a3f-4c34-8b9a-04a581c01857 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:47.849555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552400-0a3f-4c34-8b9a-04a581c01857 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:47.849740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552400-0a3f-4c34-8b9a-04a581c01857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:47.867742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-bf552400-0a3f-4c34-8b9a-04a581c01857 None None] MFA Rules not processed for user `b84ae21424694df68a96b928e15e9240`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:24:47.868927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bf552400-0a3f-4c34-8b9a-04a581c01857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:24:47.877240 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 757/1520] 10.222.0.64 () {58 vars in 1057 bytes} [Fri May 13 17:24:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:24:47.886535 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92af5e-d81a-4fa7-9f47-f6dd6e6ebf76 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:24:47.900194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92af5e-d81a-4fa7-9f47-f6dd6e6ebf76 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:24:47.905149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849bbc9-a127-4e56-a817-0f051a953371 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84ae21424694df68a96b928e15e9240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:24:47.906063 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849bbc9-a127-4e56-a817-0f051a953371 service placement] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:47.906350 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849bbc9-a127-4e56-a817-0f051a953371 service placement] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:47.906629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849bbc9-a127-4e56-a817-0f051a953371 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:47.915410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849bbc9-a127-4e56-a817-0f051a953371 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:24:47.917019 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849bbc9-a127-4e56-a817-0f051a953371 service placement] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:24:47.926416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 764/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:24:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:24:49.564722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac31af-c8cd-4282-8dd6-9e379d2d4af8 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:49.565177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac31af-c8cd-4282-8dd6-9e379d2d4af8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:49.565323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac31af-c8cd-4282-8dd6-9e379d2d4af8 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:49.566713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:24:49.571625 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884d13-0749-438b-ae17-b77b97ea259d None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:49.572039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884d13-0749-438b-ae17-b77b97ea259d None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:49.572181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884d13-0749-438b-ae17-b77b97ea259d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:49.589656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-25884d13-0749-438b-ae17-b77b97ea259d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:24:49.591105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-25884d13-0749-438b-ae17-b77b97ea259d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:24:49.598771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:24:49.748631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac31af-c8cd-4282-8dd6-9e379d2d4af8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:24:49.762613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac31af-c8cd-4282-8dd6-9e379d2d4af8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:24:49.768077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6816de-65e0-44be-a194-e68f9e34b7e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:24:49.768714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6816de-65e0-44be-a194-e68f9e34b7e5 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:49.768996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6816de-65e0-44be-a194-e68f9e34b7e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:49.769272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6816de-65e0-44be-a194-e68f9e34b7e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:49.777957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6816de-65e0-44be-a194-e68f9e34b7e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:24:49.779568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6816de-65e0-44be-a194-e68f9e34b7e5 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:24:49.789350 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 759/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:24:50.688372 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174e6b9-b8c8-499d-86d4-10275e1cf9bf None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:50.688970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174e6b9-b8c8-499d-86d4-10275e1cf9bf None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:50.688970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174e6b9-b8c8-499d-86d4-10275e1cf9bf None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:50.690309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 17:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:24:50.695723 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919725d0-d948-49f1-9cec-baedac22f261 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:50.696149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919725d0-d948-49f1-9cec-baedac22f261 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:50.696288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919725d0-d948-49f1-9cec-baedac22f261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:50.713745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-919725d0-d948-49f1-9cec-baedac22f261 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:24:50.714939 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-919725d0-d948-49f1-9cec-baedac22f261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:24:50.722957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 17:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:24:50.874757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174e6b9-b8c8-499d-86d4-10275e1cf9bf None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:24:50.892332 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174e6b9-b8c8-499d-86d4-10275e1cf9bf None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:24:50.897773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18feea8-3f21-4fc2-9c6d-35062f692b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:24:50.898418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18feea8-3f21-4fc2-9c6d-35062f692b59 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:50.898706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18feea8-3f21-4fc2-9c6d-35062f692b59 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:50.898985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18feea8-3f21-4fc2-9c6d-35062f692b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:50.907180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18feea8-3f21-4fc2-9c6d-35062f692b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:24:50.908786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18feea8-3f21-4fc2-9c6d-35062f692b59 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:24:50.918622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 767/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:24:55.063015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2567c40-cc28-4e53-a392-159ec242c405 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:55.063649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2567c40-cc28-4e53-a392-159ec242c405 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:55.063649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2567c40-cc28-4e53-a392-159ec242c405 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:55.065017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:24:55.070749 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98204-6c15-4a98-84a3-4d369a297426 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:55.078096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98204-6c15-4a98-84a3-4d369a297426 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:55.078096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98204-6c15-4a98-84a3-4d369a297426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:55.089179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-91f98204-6c15-4a98-84a3-4d369a297426 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:24:55.090379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-91f98204-6c15-4a98-84a3-4d369a297426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:24:55.098648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:24:55.135908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2567c40-cc28-4e53-a392-159ec242c405 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:24:55.137568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a2567c40-cc28-4e53-a392-159ec242c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:24:55.191777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2567c40-cc28-4e53-a392-159ec242c405 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:24:55.195893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106f70d-c5d8-45e3-b470-066d8c4f668b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:24:55.196527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106f70d-c5d8-45e3-b470-066d8c4f668b service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:55.196819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106f70d-c5d8-45e3-b470-066d8c4f668b service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:55.197095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106f70d-c5d8-45e3-b470-066d8c4f668b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:55.205720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106f70d-c5d8-45e3-b470-066d8c4f668b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:24:55.207190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106f70d-c5d8-45e3-b470-066d8c4f668b service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:24:55.216526 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 762/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:24:57.408056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b746f-dc9d-4bc5-b1a3-a78495501a7a None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:57.408619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b746f-dc9d-4bc5-b1a3-a78495501a7a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:57.408619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b746f-dc9d-4bc5-b1a3-a78495501a7a None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:57.410035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:24:57.415944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da931-6777-4f10-aef5-89875658e127 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:57.416336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da931-6777-4f10-aef5-89875658e127 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:57.416509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da931-6777-4f10-aef5-89875658e127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:57.434169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-502da931-6777-4f10-aef5-89875658e127 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:24:57.435404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-502da931-6777-4f10-aef5-89875658e127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:24:57.443036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:24:57.479109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b746f-dc9d-4bc5-b1a3-a78495501a7a None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:24:57.495679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b746f-dc9d-4bc5-b1a3-a78495501a7a None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:24:57.500190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98804e6-f52a-4233-b1f6-b03259a344c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:24:57.500832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98804e6-f52a-4233-b1f6-b03259a344c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:24:57.501114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98804e6-f52a-4233-b1f6-b03259a344c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:24:57.501393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98804e6-f52a-4233-b1f6-b03259a344c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:24:57.510269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98804e6-f52a-4233-b1f6-b03259a344c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:24:57.511769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98804e6-f52a-4233-b1f6-b03259a344c0 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:24:57.520915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 770/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:25:01.297578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b57a-c740-47a4-8467-1c36ee72a190 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:25:01.298107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b57a-c740-47a4-8467-1c36ee72a190 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:25:01.298107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b57a-c740-47a4-8467-1c36ee72a190 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:25:01.299473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:25:01.304626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d2b13-40d5-491e-a553-2c8f01d683f3 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:25:01.305029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d2b13-40d5-491e-a553-2c8f01d683f3 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:25:01.305194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d2b13-40d5-491e-a553-2c8f01d683f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:25:01.322681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-ec7d2b13-40d5-491e-a553-2c8f01d683f3 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:25:01.323910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ec7d2b13-40d5-491e-a553-2c8f01d683f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:25:01.331737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:25:01.605191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b57a-c740-47a4-8467-1c36ee72a190 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:25:01.606897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6fe1b57a-c740-47a4-8467-1c36ee72a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:25:01.662971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b57a-c740-47a4-8467-1c36ee72a190 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:25:01.666508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b86151-a7da-4489-a640-c1f6ed5c9c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:25:01.667170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86151-a7da-4489-a640-c1f6ed5c9c4c service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:25:01.667457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86151-a7da-4489-a640-c1f6ed5c9c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:25:01.667758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86151-a7da-4489-a640-c1f6ed5c9c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:25:01.676426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b86151-a7da-4489-a640-c1f6ed5c9c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:25:01.677871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b86151-a7da-4489-a640-c1f6ed5c9c4c service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:25:01.687014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 765/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:25:03.920401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fec6d-88dc-4dd7-8e7a-d23f6df11e65 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:25:03.920935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fec6d-88dc-4dd7-8e7a-d23f6df11e65 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:25:03.920935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fec6d-88dc-4dd7-8e7a-d23f6df11e65 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:25:03.922341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 17:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:25:03.927466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cbd72-5890-46a4-b815-a3f42959ee12 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:25:03.928417 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cbd72-5890-46a4-b815-a3f42959ee12 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:25:03.928550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cbd72-5890-46a4-b815-a3f42959ee12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:25:03.946469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0c3cbd72-5890-46a4-b815-a3f42959ee12 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:25:03.947679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0c3cbd72-5890-46a4-b815-a3f42959ee12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:25:03.955275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 17:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:25:04.222905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fec6d-88dc-4dd7-8e7a-d23f6df11e65 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:25:04.225113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fc6fec6d-88dc-4dd7-8e7a-d23f6df11e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:25:04.238091 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fec6d-88dc-4dd7-8e7a-d23f6df11e65 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:25:04.242258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b005-3f52-4b48-9cf7-c0341838b936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:25:04.242896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b005-3f52-4b48-9cf7-c0341838b936 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:25:04.243220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b005-3f52-4b48-9cf7-c0341838b936 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:25:04.243499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b005-3f52-4b48-9cf7-c0341838b936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:25:04.252274 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561b005-3f52-4b48-9cf7-c0341838b936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:25:04.253720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561b005-3f52-4b48-9cf7-c0341838b936 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:25:04.262989 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 773/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:36.349505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2bed3-7558-4975-9eef-5ba4f43a902c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.350141 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2bed3-7558-4975-9eef-5ba4f43a902c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.350425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2bed3-7558-4975-9eef-5ba4f43a902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.357150 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3252fba-e9bf-4c71-becc-55235fc7a936 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.358167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3252fba-e9bf-4c71-becc-55235fc7a936 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.358614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3252fba-e9bf-4c71-becc-55235fc7a936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.388304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a3252fba-e9bf-4c71-becc-55235fc7a936 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.390162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a3252fba-e9bf-4c71-becc-55235fc7a936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.400965 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f2b2bed3-7558-4975-9eef-5ba4f43a902c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.402574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f2b2bed3-7558-4975-9eef-5ba4f43a902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.409437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 774/1540] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:26:36.417661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 767/1541] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:36.426692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6d172-acda-4965-b654-3ae9b07f6b5f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.426931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f0cc3-52e3-442c-9c7c-89d3cc3df2bb None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.427043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f0cc3-52e3-442c-9c7c-89d3cc3df2bb None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.427432 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f0cc3-52e3-442c-9c7c-89d3cc3df2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.428192 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6d172-acda-4965-b654-3ae9b07f6b5f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.428703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6d172-acda-4965-b654-3ae9b07f6b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.453675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-36e6d172-acda-4965-b654-3ae9b07f6b5f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.459622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-36e6d172-acda-4965-b654-3ae9b07f6b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.460230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-9e9f0cc3-52e3-442c-9c7c-89d3cc3df2bb None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.461418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-9e9f0cc3-52e3-442c-9c7c-89d3cc3df2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.474465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 768/1542] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:36.481153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 775/1543] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:26:36.482002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6d172-acda-4965-b654-3ae9b07f6b5f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:36.486401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f0cc3-52e3-442c-9c7c-89d3cc3df2bb None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:36.494266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6d172-acda-4965-b654-3ae9b07f6b5f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:36.500472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f0cc3-52e3-442c-9c7c-89d3cc3df2bb None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:36.503452 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fa559-05d2-47df-972c-5f2b63b44d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:36.504391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa559-05d2-47df-972c-5f2b63b44d09 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.504898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa559-05d2-47df-972c-5f2b63b44d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.507693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa559-05d2-47df-972c-5f2b63b44d09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.508088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fa559-05d2-47df-972c-5f2b63b44d09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:26:36.508472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fa559-05d2-47df-972c-5f2b63b44d09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:36.510451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fa559-05d2-47df-972c-5f2b63b44d09 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:36.515223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b6ac-73a7-4972-a77e-edcfeb3e6783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:36.515904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b6ac-73a7-4972-a77e-edcfeb3e6783 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.516686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b6ac-73a7-4972-a77e-edcfeb3e6783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.516686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b6ac-73a7-4972-a77e-edcfeb3e6783 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.517476 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570b6ac-73a7-4972-a77e-edcfeb3e6783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:26:36.517792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570b6ac-73a7-4972-a77e-edcfeb3e6783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:36.518827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: WARNING py.warnings [None req-7570b6ac-73a7-4972-a77e-edcfeb3e6783 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:26:36.518827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: warnings.warn(msg) May 13 17:26:36.518827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: May 13 17:26:36.519754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570b6ac-73a7-4972-a77e-edcfeb3e6783 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:36.535493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 769/1544] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:26:36.538170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 776/1545] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:26:36.538270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649488a-0b68-49ce-b483-b2a039c439f5 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.538359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049aa79-b861-4f67-aaa9-1a196ce33b40 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.538443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649488a-0b68-49ce-b483-b2a039c439f5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.538541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049aa79-b861-4f67-aaa9-1a196ce33b40 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.538627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649488a-0b68-49ce-b483-b2a039c439f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.538736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049aa79-b861-4f67-aaa9-1a196ce33b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.573287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e649488a-0b68-49ce-b483-b2a039c439f5 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.575098 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e649488a-0b68-49ce-b483-b2a039c439f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.576645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d049aa79-b861-4f67-aaa9-1a196ce33b40 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.577828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d049aa79-b861-4f67-aaa9-1a196ce33b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.594421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 770/1546] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:36.596419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65399b-83a2-41bc-b85e-93fd6a6cdc75 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.596709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65399b-83a2-41bc-b85e-93fd6a6cdc75 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.596893 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 777/1547] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:36.596988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65399b-83a2-41bc-b85e-93fd6a6cdc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.597640 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049aa79-b861-4f67-aaa9-1a196ce33b40 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:36.614649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049aa79-b861-4f67-aaa9-1a196ce33b40 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:36.621591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cca7c-0201-443d-b8ef-d8ccd01cbedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:36.622253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cca7c-0201-443d-b8ef-d8ccd01cbedc admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.622535 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cca7c-0201-443d-b8ef-d8ccd01cbedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.622808 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cca7c-0201-443d-b8ef-d8ccd01cbedc admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.623590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cca7c-0201-443d-b8ef-d8ccd01cbedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:36.625530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cca7c-0201-443d-b8ef-d8ccd01cbedc admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:36.629536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ed65399b-83a2-41bc-b85e-93fd6a6cdc75 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.631017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ed65399b-83a2-41bc-b85e-93fd6a6cdc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.640433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 771/1548] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:36.642674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65399b-83a2-41bc-b85e-93fd6a6cdc75 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:36.659422 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65399b-83a2-41bc-b85e-93fd6a6cdc75 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:36.661257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1f230-031d-4bc7-9876-eb5b8b5b32c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:36.661947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1f230-031d-4bc7-9876-eb5b8b5b32c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.662228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1f230-031d-4bc7-9876-eb5b8b5b32c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.662501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1f230-031d-4bc7-9876-eb5b8b5b32c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.663219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1f230-031d-4bc7-9876-eb5b8b5b32c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:36.665661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-3de1f230-031d-4bc7-9876-eb5b8b5b32c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 17:26:36.665661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: warnings.warn(msg) May 13 17:26:36.665661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: May 13 17:26:36.665661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1f230-031d-4bc7-9876-eb5b8b5b32c4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:36.759399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 778/1549] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:36.760719 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca667a-aac3-437c-ae37-5d0a241e82bd None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.761012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca667a-aac3-437c-ae37-5d0a241e82bd None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.761289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca667a-aac3-437c-ae37-5d0a241e82bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.778834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e3ca667a-aac3-437c-ae37-5d0a241e82bd None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.780811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e3ca667a-aac3-437c-ae37-5d0a241e82bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.796719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 772/1550] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:36.796719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b16b-1204-46f4-83f3-3a01e0f0c521 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.796719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b16b-1204-46f4-83f3-3a01e0f0c521 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.796719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b16b-1204-46f4-83f3-3a01e0f0c521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.813263 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7815b16b-1204-46f4-83f3-3a01e0f0c521 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.814539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7815b16b-1204-46f4-83f3-3a01e0f0c521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.837490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 779/1551] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:36.838785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909bec0-2f54-4748-96a3-fe2350d6ef68 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.839075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909bec0-2f54-4748-96a3-fe2350d6ef68 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.839381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909bec0-2f54-4748-96a3-fe2350d6ef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.863041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-6909bec0-2f54-4748-96a3-fe2350d6ef68 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.864261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-6909bec0-2f54-4748-96a3-fe2350d6ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.871762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 773/1552] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:36.873580 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0b6d-9cbc-4020-be3c-8873ea96e4f0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.873870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0b6d-9cbc-4020-be3c-8873ea96e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.874151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0b6d-9cbc-4020-be3c-8873ea96e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.891588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a51a0b6d-9cbc-4020-be3c-8873ea96e4f0 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.892776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a51a0b6d-9cbc-4020-be3c-8873ea96e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.900616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 774/1553] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:36.901895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f1fe3-8182-47d7-bccc-aa937e008765 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.902188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f1fe3-8182-47d7-bccc-aa937e008765 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.902466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f1fe3-8182-47d7-bccc-aa937e008765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.919248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-381f1fe3-8182-47d7-bccc-aa937e008765 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.920453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-381f1fe3-8182-47d7-bccc-aa937e008765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.922215 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 780/1554] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:36.923557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac7ccd-c5b2-40bf-a0dd-c8703ceafac1 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.923844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac7ccd-c5b2-40bf-a0dd-c8703ceafac1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.924141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac7ccd-c5b2-40bf-a0dd-c8703ceafac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.933355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 775/1555] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:36.934290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f1fe3-8182-47d7-bccc-aa937e008765 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:36.944246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-b2ac7ccd-c5b2-40bf-a0dd-c8703ceafac1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:36.945464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b2ac7ccd-c5b2-40bf-a0dd-c8703ceafac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:36.947073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f1fe3-8182-47d7-bccc-aa937e008765 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:36.952397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb559ffe-2449-4ffe-aad7-b1de8c7465de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:36.953055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559ffe-2449-4ffe-aad7-b1de8c7465de admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.953336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559ffe-2449-4ffe-aad7-b1de8c7465de admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.953609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559ffe-2449-4ffe-aad7-b1de8c7465de admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.953919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 781/1556] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:36.957423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac7ccd-c5b2-40bf-a0dd-c8703ceafac1 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:36.957551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb559ffe-2449-4ffe-aad7-b1de8c7465de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:36.957551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb559ffe-2449-4ffe-aad7-b1de8c7465de admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:36.966399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac7ccd-c5b2-40bf-a0dd-c8703ceafac1 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:36.971226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6f634-2dcf-403b-8f3a-526d2f395e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:36.971926 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6f634-2dcf-403b-8f3a-526d2f395e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:36.972207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6f634-2dcf-403b-8f3a-526d2f395e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:36.972480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6f634-2dcf-403b-8f3a-526d2f395e90 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:36.973160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6f634-2dcf-403b-8f3a-526d2f395e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:36.974181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: WARNING py.warnings [None req-14d6f634-2dcf-403b-8f3a-526d2f395e90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 17:26:36.974181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: warnings.warn(msg) May 13 17:26:36.974181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: May 13 17:26:36.975422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6f634-2dcf-403b-8f3a-526d2f395e90 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.067769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 776/1557] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:37.069214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db17ab-1af4-45df-87ca-b1467a588904 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.069513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db17ab-1af4-45df-87ca-b1467a588904 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.069939 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db17ab-1af4-45df-87ca-b1467a588904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.087270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 782/1558] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:26:36 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:37.087270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6f634-2dcf-403b-8f3a-526d2f395e90 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.091476 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-27db17ab-1af4-45df-87ca-b1467a588904 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:37.092956 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-27db17ab-1af4-45df-87ca-b1467a588904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:37.095148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6f634-2dcf-403b-8f3a-526d2f395e90 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.099848 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ebc62-cf3b-4744-b880-570a4f885b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.105983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ebc62-cf3b-4744-b880-570a4f885b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.105983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ebc62-cf3b-4744-b880-570a4f885b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.106191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 777/1559] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:37.106285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ebc62-cf3b-4744-b880-570a4f885b2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.106384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db17ab-1af4-45df-87ca-b1467a588904 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.106488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ebc62-cf3b-4744-b880-570a4f885b2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:26:37.106488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ebc62-cf3b-4744-b880-570a4f885b2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.106488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ebc62-cf3b-4744-b880-570a4f885b2f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.112017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db17ab-1af4-45df-87ca-b1467a588904 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.116700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64b3a8-f3b3-494a-a549-ef5124fb943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.117352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b3a8-f3b3-494a-a549-ef5124fb943a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.117636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b3a8-f3b3-494a-a549-ef5124fb943a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.117882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 783/1560] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:26:37.118023 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b3a8-f3b3-494a-a549-ef5124fb943a admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.118695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64b3a8-f3b3-494a-a549-ef5124fb943a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:26:37.119011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64b3a8-f3b3-494a-a549-ef5124fb943a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.119154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fd58d-ec58-4657-a266-3cbaffb82158 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.119436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fd58d-ec58-4657-a266-3cbaffb82158 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.119716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fd58d-ec58-4657-a266-3cbaffb82158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.120926 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64b3a8-f3b3-494a-a549-ef5124fb943a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.141052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 778/1561] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:26:37.141052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3557ed7-e94f-42a6-8e5a-458aabbeb570 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.141052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3557ed7-e94f-42a6-8e5a-458aabbeb570 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.141052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3557ed7-e94f-42a6-8e5a-458aabbeb570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.142657 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-8a5fd58d-ec58-4657-a266-3cbaffb82158 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:37.143951 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8a5fd58d-ec58-4657-a266-3cbaffb82158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:37.151801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 784/1562] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:37.152570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fd58d-ec58-4657-a266-3cbaffb82158 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.156125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c3557ed7-e94f-42a6-8e5a-458aabbeb570 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:37.157346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c3557ed7-e94f-42a6-8e5a-458aabbeb570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:37.164167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fd58d-ec58-4657-a266-3cbaffb82158 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.165645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 779/1563] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:37.166486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3557ed7-e94f-42a6-8e5a-458aabbeb570 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.172630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e756555-aabb-4342-a5d8-f480cf46ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.173295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e756555-aabb-4342-a5d8-f480cf46ce19 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.173590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e756555-aabb-4342-a5d8-f480cf46ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.173869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e756555-aabb-4342-a5d8-f480cf46ce19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.174604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e756555-aabb-4342-a5d8-f480cf46ce19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:26:37.174912 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e756555-aabb-4342-a5d8-f480cf46ce19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.176565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e756555-aabb-4342-a5d8-f480cf46ce19 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.176730 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3557ed7-e94f-42a6-8e5a-458aabbeb570 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.181245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62de657-1eef-4c6f-ba0f-e07f8759a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.181876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62de657-1eef-4c6f-ba0f-e07f8759a114 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.182162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62de657-1eef-4c6f-ba0f-e07f8759a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.182438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62de657-1eef-4c6f-ba0f-e07f8759a114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.183178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62de657-1eef-4c6f-ba0f-e07f8759a114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.184781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62de657-1eef-4c6f-ba0f-e07f8759a114 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.189123 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 785/1564] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:26:37.189918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e756555-aabb-4342-a5d8-f480cf46ce19 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.197917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 780/1565] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:37.197917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62de657-1eef-4c6f-ba0f-e07f8759a114 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.202249 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e756555-aabb-4342-a5d8-f480cf46ce19 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.206162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62de657-1eef-4c6f-ba0f-e07f8759a114 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.206769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84caef2-6813-4946-88c9-0366fae3edb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.207451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84caef2-6813-4946-88c9-0366fae3edb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.207736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84caef2-6813-4946-88c9-0366fae3edb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.208015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84caef2-6813-4946-88c9-0366fae3edb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.208741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84caef2-6813-4946-88c9-0366fae3edb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.210336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84caef2-6813-4946-88c9-0366fae3edb9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.210751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949cbe9-9127-4828-b0e1-9788b218d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.211420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949cbe9-9127-4828-b0e1-9788b218d937 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.211703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949cbe9-9127-4828-b0e1-9788b218d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.211974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949cbe9-9127-4828-b0e1-9788b218d937 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.212702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949cbe9-9127-4828-b0e1-9788b218d937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:26:37.213026 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949cbe9-9127-4828-b0e1-9788b218d937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.214597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949cbe9-9127-4828-b0e1-9788b218d937 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.223546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 786/1566] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:37.223546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84caef2-6813-4946-88c9-0366fae3edb9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.236697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 781/1567] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:26:37.236697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949cbe9-9127-4828-b0e1-9788b218d937 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.236980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84caef2-6813-4946-88c9-0366fae3edb9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.236980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53050f-e1f2-45bf-9a18-59b72a7d4044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.236980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53050f-e1f2-45bf-9a18-59b72a7d4044 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.236980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53050f-e1f2-45bf-9a18-59b72a7d4044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.237272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53050f-e1f2-45bf-9a18-59b72a7d4044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.237607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53050f-e1f2-45bf-9a18-59b72a7d4044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.239562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53050f-e1f2-45bf-9a18-59b72a7d4044 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.239936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949cbe9-9127-4828-b0e1-9788b218d937 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.244680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7164e-0686-4677-957d-0e2ed4837cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.245333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7164e-0686-4677-957d-0e2ed4837cce admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.245791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7164e-0686-4677-957d-0e2ed4837cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.246145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7164e-0686-4677-957d-0e2ed4837cce admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.246846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7164e-0686-4677-957d-0e2ed4837cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.248877 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7164e-0686-4677-957d-0e2ed4837cce admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.364771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 787/1568] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:26:37 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:37.365754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53050f-e1f2-45bf-9a18-59b72a7d4044 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.382761 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 782/1569] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:26:37 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:37.383636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7164e-0686-4677-957d-0e2ed4837cce admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.428657 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53050f-e1f2-45bf-9a18-59b72a7d4044 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.442679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7164e-0686-4677-957d-0e2ed4837cce admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.447325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b2c86-6b21-48ad-b290-44587879866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.447993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2c86-6b21-48ad-b290-44587879866a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.448278 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2c86-6b21-48ad-b290-44587879866a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.448560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2c86-6b21-48ad-b290-44587879866a admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.449283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b2c86-6b21-48ad-b290-44587879866a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:26:37.449593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b2c86-6b21-48ad-b290-44587879866a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.451261 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b2c86-6b21-48ad-b290-44587879866a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.463748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 783/1570] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:26:37.464537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b2c86-6b21-48ad-b290-44587879866a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.474339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b2c86-6b21-48ad-b290-44587879866a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.478857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20cf88-8105-4eff-a35b-a02ace0a3b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.479517 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20cf88-8105-4eff-a35b-a02ace0a3b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.479797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20cf88-8105-4eff-a35b-a02ace0a3b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.480070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20cf88-8105-4eff-a35b-a02ace0a3b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.480739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20cf88-8105-4eff-a35b-a02ace0a3b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.482659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20cf88-8105-4eff-a35b-a02ace0a3b03 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.483336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050f43e-2e36-4148-8e74-b3e69eeecc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.483999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050f43e-2e36-4148-8e74-b3e69eeecc2c admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.484288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050f43e-2e36-4148-8e74-b3e69eeecc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.484568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050f43e-2e36-4148-8e74-b3e69eeecc2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.485856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050f43e-2e36-4148-8e74-b3e69eeecc2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:26:37.486164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050f43e-2e36-4148-8e74-b3e69eeecc2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.487798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050f43e-2e36-4148-8e74-b3e69eeecc2c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.498860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 788/1571] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:26:37.500263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050f43e-2e36-4148-8e74-b3e69eeecc2c admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.509869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050f43e-2e36-4148-8e74-b3e69eeecc2c admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.514465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81694-341c-406b-a871-295fe2841481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.515658 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81694-341c-406b-a871-295fe2841481 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.515658 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81694-341c-406b-a871-295fe2841481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.515883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81694-341c-406b-a871-295fe2841481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.516462 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c81694-341c-406b-a871-295fe2841481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.518027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c81694-341c-406b-a871-295fe2841481 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.528187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 789/1572] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:37.529088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81694-341c-406b-a871-295fe2841481 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.538636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81694-341c-406b-a871-295fe2841481 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.543239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8c6ea-7f23-4523-b842-a49cffe4df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.543865 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c6ea-7f23-4523-b842-a49cffe4df61 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.544138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c6ea-7f23-4523-b842-a49cffe4df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.544421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c6ea-7f23-4523-b842-a49cffe4df61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.545126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8c6ea-7f23-4523-b842-a49cffe4df61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.547241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8c6ea-7f23-4523-b842-a49cffe4df61 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.556663 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 790/1573] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:37.557522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8c6ea-7f23-4523-b842-a49cffe4df61 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.566539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8c6ea-7f23-4523-b842-a49cffe4df61 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.571032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a80a-fad8-4e0a-b0c5-eac92808f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.571650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a80a-fad8-4e0a-b0c5-eac92808f858 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.571942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a80a-fad8-4e0a-b0c5-eac92808f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.572222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a80a-fad8-4e0a-b0c5-eac92808f858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.572900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38a80a-fad8-4e0a-b0c5-eac92808f858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.574790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38a80a-fad8-4e0a-b0c5-eac92808f858 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.581963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 784/1574] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:26:37 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:37.583003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20cf88-8105-4eff-a35b-a02ace0a3b03 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.644450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20cf88-8105-4eff-a35b-a02ace0a3b03 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.649057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21867241-28de-4ed9-b156-970a42a23cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.649727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21867241-28de-4ed9-b156-970a42a23cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.650009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21867241-28de-4ed9-b156-970a42a23cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.650281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21867241-28de-4ed9-b156-970a42a23cfd admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.650964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21867241-28de-4ed9-b156-970a42a23cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.652980 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21867241-28de-4ed9-b156-970a42a23cfd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.704234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 791/1575] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:26:37 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:37.704234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a80a-fad8-4e0a-b0c5-eac92808f858 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.759671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a80a-fad8-4e0a-b0c5-eac92808f858 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.764199 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93024fd-a2ac-46c0-a0d1-beeaabc7d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.767268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93024fd-a2ac-46c0-a0d1-beeaabc7d49c admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.767268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93024fd-a2ac-46c0-a0d1-beeaabc7d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.767268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93024fd-a2ac-46c0-a0d1-beeaabc7d49c admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.767268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93024fd-a2ac-46c0-a0d1-beeaabc7d49c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.768022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93024fd-a2ac-46c0-a0d1-beeaabc7d49c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.797790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 785/1576] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:26:37 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:37.798718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21867241-28de-4ed9-b156-970a42a23cfd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.807905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21867241-28de-4ed9-b156-970a42a23cfd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.812460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee6963-abb3-42bd-9e72-334102129837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.813080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee6963-abb3-42bd-9e72-334102129837 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.813371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee6963-abb3-42bd-9e72-334102129837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.813693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee6963-abb3-42bd-9e72-334102129837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.814361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee6963-abb3-42bd-9e72-334102129837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.816328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee6963-abb3-42bd-9e72-334102129837 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.881248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 792/1577] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:26:37 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:37.881248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93024fd-a2ac-46c0-a0d1-beeaabc7d49c admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.888369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93024fd-a2ac-46c0-a0d1-beeaabc7d49c admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.893366 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af232b-5778-4eac-aca6-d5d3b8b258e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.894073 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af232b-5778-4eac-aca6-d5d3b8b258e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.894359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af232b-5778-4eac-aca6-d5d3b8b258e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.894636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af232b-5778-4eac-aca6-d5d3b8b258e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.895350 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af232b-5778-4eac-aca6-d5d3b8b258e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.897251 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af232b-5778-4eac-aca6-d5d3b8b258e9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.902635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 786/1578] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:26:37 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:37.905035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee6963-abb3-42bd-9e72-334102129837 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:37.962795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee6963-abb3-42bd-9e72-334102129837 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:37.967743 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cf1c4-a43a-44db-a05b-44dd356cc174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:37.969223 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cf1c4-a43a-44db-a05b-44dd356cc174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:37.969507 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cf1c4-a43a-44db-a05b-44dd356cc174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:37.969811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cf1c4-a43a-44db-a05b-44dd356cc174 admin admin] PATH_INFO: `/v3/projects/dfee22416d864723ab9cf3d9ad41f586/users/b8bc4bb32ef24674970b3b2b3044b50d/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:37.983667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cf1c4-a43a-44db-a05b-44dd356cc174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfee22416d864723ab9cf3d9ad41f586, user_id=b8bc4bb32ef24674970b3b2b3044b50d, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:37.984848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-a55cf1c4-a43a-44db-a05b-44dd356cc174 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 17:26:37.984848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: warnings.warn(msg) May 13 17:26:37.984848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: May 13 17:26:37.986791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cf1c4-a43a-44db-a05b-44dd356cc174 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:37.999866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 793/1579] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:26:37 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:38.000878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af232b-5778-4eac-aca6-d5d3b8b258e9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.061534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af232b-5778-4eac-aca6-d5d3b8b258e9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.067179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 787/1580] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:37 2022] PUT /identity/v3/projects/dfee22416d864723ab9cf3d9ad41f586/users/b8bc4bb32ef24674970b3b2b3044b50d/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:38.068169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cf1c4-a43a-44db-a05b-44dd356cc174 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.116214 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df37a4-41c7-4500-9eb9-0ed0e5a3fe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.117108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df37a4-41c7-4500-9eb9-0ed0e5a3fe7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.117384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df37a4-41c7-4500-9eb9-0ed0e5a3fe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.117656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df37a4-41c7-4500-9eb9-0ed0e5a3fe7c admin admin] PATH_INFO: `/v3/projects/ae7b37b41d944427945d783a460ca12a/users/dfc52b61bcf845d1953a5a111abb3666/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.131844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df37a4-41c7-4500-9eb9-0ed0e5a3fe7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7b37b41d944427945d783a460ca12a, user_id=dfc52b61bcf845d1953a5a111abb3666, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.134708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df37a4-41c7-4500-9eb9-0ed0e5a3fe7c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.135326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cf1c4-a43a-44db-a05b-44dd356cc174 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.139958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa8432-e7ac-4fda-9a5d-a3fa2e3e0297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.141161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa8432-e7ac-4fda-9a5d-a3fa2e3e0297 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.141449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa8432-e7ac-4fda-9a5d-a3fa2e3e0297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.141787 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa8432-e7ac-4fda-9a5d-a3fa2e3e0297 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.142482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa8432-e7ac-4fda-9a5d-a3fa2e3e0297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.144516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa8432-e7ac-4fda-9a5d-a3fa2e3e0297 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.203770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 794/1581] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:37 2022] PUT /identity/v3/projects/ae7b37b41d944427945d783a460ca12a/users/dfc52b61bcf845d1953a5a111abb3666/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:38.204564 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df37a4-41c7-4500-9eb9-0ed0e5a3fe7c admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.238471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 788/1582] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:26:38 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:38.239880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa8432-e7ac-4fda-9a5d-a3fa2e3e0297 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.249538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa8432-e7ac-4fda-9a5d-a3fa2e3e0297 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.263907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df37a4-41c7-4500-9eb9-0ed0e5a3fe7c admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.269214 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fae4b-9eb8-459d-b340-16d85f27bc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.269882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fae4b-9eb8-459d-b340-16d85f27bc65 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.270168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fae4b-9eb8-459d-b340-16d85f27bc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.270448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fae4b-9eb8-459d-b340-16d85f27bc65 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.271167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fae4b-9eb8-459d-b340-16d85f27bc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.273145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fae4b-9eb8-459d-b340-16d85f27bc65 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.303777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054f6a7-fe14-4476-a148-ef982f6105cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.304501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054f6a7-fe14-4476-a148-ef982f6105cb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.304786 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054f6a7-fe14-4476-a148-ef982f6105cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.305059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054f6a7-fe14-4476-a148-ef982f6105cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.305775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054f6a7-fe14-4476-a148-ef982f6105cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.307420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054f6a7-fe14-4476-a148-ef982f6105cb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.321534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 789/1583] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.322503 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054f6a7-fe14-4476-a148-ef982f6105cb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.332931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054f6a7-fe14-4476-a148-ef982f6105cb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.337419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5950f-dd53-494c-9bc8-b9291ad70d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.338039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5950f-dd53-494c-9bc8-b9291ad70d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.338322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5950f-dd53-494c-9bc8-b9291ad70d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.338597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5950f-dd53-494c-9bc8-b9291ad70d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.339366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5950f-dd53-494c-9bc8-b9291ad70d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.340954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5950f-dd53-494c-9bc8-b9291ad70d1c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.355802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 790/1584] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.356691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5950f-dd53-494c-9bc8-b9291ad70d1c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.361425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 795/1585] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:26:38 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:38.361425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fae4b-9eb8-459d-b340-16d85f27bc65 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.367287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5950f-dd53-494c-9bc8-b9291ad70d1c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.369691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fae4b-9eb8-459d-b340-16d85f27bc65 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.371987 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584085d-4776-4e33-b94f-b6da294bb7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.372661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584085d-4776-4e33-b94f-b6da294bb7bb admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.372927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584085d-4776-4e33-b94f-b6da294bb7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.373202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584085d-4776-4e33-b94f-b6da294bb7bb admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.373950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584085d-4776-4e33-b94f-b6da294bb7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.375344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77cd69-6895-4e7a-b48a-511dd302a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.376053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77cd69-6895-4e7a-b48a-511dd302a917 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.376351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77cd69-6895-4e7a-b48a-511dd302a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.376607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77cd69-6895-4e7a-b48a-511dd302a917 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.376718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584085d-4776-4e33-b94f-b6da294bb7bb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.377283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77cd69-6895-4e7a-b48a-511dd302a917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.379326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77cd69-6895-4e7a-b48a-511dd302a917 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.438750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 791/1586] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:26:38 2022] POST /identity/v3/users => generated 292 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:38.440104 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84300e05-11aa-4e59-bb39-665a05fe7f21 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.440390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84300e05-11aa-4e59-bb39-665a05fe7f21 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.440662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84300e05-11aa-4e59-bb39-665a05fe7f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.452681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 796/1587] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:26:38 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:38.452681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947d0e-0220-42a8-8ed7-83bd34f52f5d None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.452681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947d0e-0220-42a8-8ed7-83bd34f52f5d None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.452681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947d0e-0220-42a8-8ed7-83bd34f52f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.467310 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-84300e05-11aa-4e59-bb39-665a05fe7f21 None None] MFA Rules not processed for user `b8bc4bb32ef24674970b3b2b3044b50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:38.468553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-84300e05-11aa-4e59-bb39-665a05fe7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:38.469662 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d9947d0e-0220-42a8-8ed7-83bd34f52f5d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:38.470848 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d9947d0e-0220-42a8-8ed7-83bd34f52f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:38.478460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 797/1588] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:38.479302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947d0e-0220-42a8-8ed7-83bd34f52f5d None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.488553 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947d0e-0220-42a8-8ed7-83bd34f52f5d None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.493213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc969cbb-4bea-42f6-b214-d7776181ba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.493868 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc969cbb-4bea-42f6-b214-d7776181ba92 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.494160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc969cbb-4bea-42f6-b214-d7776181ba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.494433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc969cbb-4bea-42f6-b214-d7776181ba92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.495185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc969cbb-4bea-42f6-b214-d7776181ba92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.496867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc969cbb-4bea-42f6-b214-d7776181ba92 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.507217 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 798/1589] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.508007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc969cbb-4bea-42f6-b214-d7776181ba92 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.518064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc969cbb-4bea-42f6-b214-d7776181ba92 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.522654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29011b-b847-4c6c-9a68-e82bf17db3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.523324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29011b-b847-4c6c-9a68-e82bf17db3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.524807 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29011b-b847-4c6c-9a68-e82bf17db3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.524807 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29011b-b847-4c6c-9a68-e82bf17db3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.524807 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29011b-b847-4c6c-9a68-e82bf17db3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.526205 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29011b-b847-4c6c-9a68-e82bf17db3ad admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.532465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 792/1590] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:38.533306 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84300e05-11aa-4e59-bb39-665a05fe7f21 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.536885 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 799/1591] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.537551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29011b-b847-4c6c-9a68-e82bf17db3ad admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.543443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84300e05-11aa-4e59-bb39-665a05fe7f21 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.547643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29011b-b847-4c6c-9a68-e82bf17db3ad admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.553721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3257471-335a-405e-8f37-11af0b5a3952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.553721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3257471-335a-405e-8f37-11af0b5a3952 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.553721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3257471-335a-405e-8f37-11af0b5a3952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.553721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3257471-335a-405e-8f37-11af0b5a3952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.554120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3257471-335a-405e-8f37-11af0b5a3952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.554210 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358c636-9f6f-4e77-921f-07cce7318659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.554316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3257471-335a-405e-8f37-11af0b5a3952 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.554406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358c636-9f6f-4e77-921f-07cce7318659 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.554406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358c636-9f6f-4e77-921f-07cce7318659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.554406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358c636-9f6f-4e77-921f-07cce7318659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.554406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358c636-9f6f-4e77-921f-07cce7318659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.555690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358c636-9f6f-4e77-921f-07cce7318659 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.562221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 793/1592] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.562964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3257471-335a-405e-8f37-11af0b5a3952 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.566304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 800/1593] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.567002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358c636-9f6f-4e77-921f-07cce7318659 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.572131 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3257471-335a-405e-8f37-11af0b5a3952 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.576545 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358c636-9f6f-4e77-921f-07cce7318659 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.576665 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42dcc6-c85f-4923-9ef2-d5fc5524be6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.577304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42dcc6-c85f-4923-9ef2-d5fc5524be6d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.577582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42dcc6-c85f-4923-9ef2-d5fc5524be6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.577848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42dcc6-c85f-4923-9ef2-d5fc5524be6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.578554 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42dcc6-c85f-4923-9ef2-d5fc5524be6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.580199 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42dcc6-c85f-4923-9ef2-d5fc5524be6d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.581133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b7637-793d-420c-b392-ae7c818c222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.581765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b7637-793d-420c-b392-ae7c818c222a admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.582049 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b7637-793d-420c-b392-ae7c818c222a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.582326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b7637-793d-420c-b392-ae7c818c222a admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.583040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b7637-793d-420c-b392-ae7c818c222a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.584727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b7637-793d-420c-b392-ae7c818c222a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.590100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 794/1594] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.590883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42dcc6-c85f-4923-9ef2-d5fc5524be6d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.595354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 801/1595] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.596052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b7637-793d-420c-b392-ae7c818c222a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.605470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b7637-793d-420c-b392-ae7c818c222a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.610625 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1732-9dda-43f8-a5d4-b3c934ef57b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.611320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1732-9dda-43f8-a5d4-b3c934ef57b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.611719 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1732-9dda-43f8-a5d4-b3c934ef57b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.612002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1732-9dda-43f8-a5d4-b3c934ef57b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.612720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e1732-9dda-43f8-a5d4-b3c934ef57b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.614337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e1732-9dda-43f8-a5d4-b3c934ef57b6 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.624044 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 802/1596] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.624849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1732-9dda-43f8-a5d4-b3c934ef57b6 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.636670 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1732-9dda-43f8-a5d4-b3c934ef57b6 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.641813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8be58-c0b7-4b8d-ae87-05d9d7cd44a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.642677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8be58-c0b7-4b8d-ae87-05d9d7cd44a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.642960 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8be58-c0b7-4b8d-ae87-05d9d7cd44a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.643273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8be58-c0b7-4b8d-ae87-05d9d7cd44a2 admin admin] PATH_INFO: `/v3/projects/21feba785ece4f3fb703519584e760f7/users/cd48fac53626402192e203cf80cfc22f/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.646584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42dcc6-c85f-4923-9ef2-d5fc5524be6d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.650244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231b3cd-53a3-4828-9962-a59fc1881899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.650891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231b3cd-53a3-4828-9962-a59fc1881899 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.651206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231b3cd-53a3-4828-9962-a59fc1881899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.651492 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231b3cd-53a3-4828-9962-a59fc1881899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.658104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8be58-c0b7-4b8d-ae87-05d9d7cd44a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21feba785ece4f3fb703519584e760f7, user_id=cd48fac53626402192e203cf80cfc22f, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.660828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8be58-c0b7-4b8d-ae87-05d9d7cd44a2 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.661103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231b3cd-53a3-4828-9962-a59fc1881899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.662564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231b3cd-53a3-4828-9962-a59fc1881899 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.671899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 795/1597] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:38.673676 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231b3cd-53a3-4828-9962-a59fc1881899 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.725321 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231b3cd-53a3-4828-9962-a59fc1881899 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.728961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff097-6186-49f1-ae46-706c573a109c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.729606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff097-6186-49f1-ae46-706c573a109c service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.729889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff097-6186-49f1-ae46-706c573a109c service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.730162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff097-6186-49f1-ae46-706c573a109c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.738635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eff097-6186-49f1-ae46-706c573a109c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.740069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eff097-6186-49f1-ae46-706c573a109c service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.748669 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 796/1598] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:38.749423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff097-6186-49f1-ae46-706c573a109c service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.759081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff097-6186-49f1-ae46-706c573a109c service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.773507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 803/1599] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:38 2022] PUT /identity/v3/projects/21feba785ece4f3fb703519584e760f7/users/cd48fac53626402192e203cf80cfc22f/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:38.773507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8be58-c0b7-4b8d-ae87-05d9d7cd44a2 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.839616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69c7d6-4d3b-41e8-80f8-17cfab44352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.840604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c7d6-4d3b-41e8-80f8-17cfab44352b admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.841074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c7d6-4d3b-41e8-80f8-17cfab44352b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.841419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c7d6-4d3b-41e8-80f8-17cfab44352b admin admin] PATH_INFO: `/v3/projects/f8e7b818f3a74fc48f0faeeb3398069a/users/efc23cbdbebc423baed1a2cb6c6cd7e7/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.842584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8be58-c0b7-4b8d-ae87-05d9d7cd44a2 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.849193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c14787-d9f6-40a4-bf90-c0ffe0192ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.850391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c14787-d9f6-40a4-bf90-c0ffe0192ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.850799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c14787-d9f6-40a4-bf90-c0ffe0192ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.851194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c14787-d9f6-40a4-bf90-c0ffe0192ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.852206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c14787-d9f6-40a4-bf90-c0ffe0192ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.853983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c14787-d9f6-40a4-bf90-c0ffe0192ac7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.858889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69c7d6-4d3b-41e8-80f8-17cfab44352b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e7b818f3a74fc48f0faeeb3398069a, user_id=efc23cbdbebc423baed1a2cb6c6cd7e7, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.861890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69c7d6-4d3b-41e8-80f8-17cfab44352b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.867452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 804/1600] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.868483 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c14787-d9f6-40a4-bf90-c0ffe0192ac7 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.880429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c14787-d9f6-40a4-bf90-c0ffe0192ac7 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.885709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9a577-91d9-4dfc-bad3-3347111629d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.886464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9a577-91d9-4dfc-bad3-3347111629d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.886820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9a577-91d9-4dfc-bad3-3347111629d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.887107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9a577-91d9-4dfc-bad3-3347111629d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.887875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9a577-91d9-4dfc-bad3-3347111629d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.891869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9a577-91d9-4dfc-bad3-3347111629d1 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.900786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 805/1601] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.901703 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9a577-91d9-4dfc-bad3-3347111629d1 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.912094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9a577-91d9-4dfc-bad3-3347111629d1 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.917238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c01161-94db-44d4-b326-f723fd935ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:38.917974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01161-94db-44d4-b326-f723fd935ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.920577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01161-94db-44d4-b326-f723fd935ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.920577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01161-94db-44d4-b326-f723fd935ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.920577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c01161-94db-44d4-b326-f723fd935ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:38.921126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c01161-94db-44d4-b326-f723fd935ec9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:38.931994 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 806/1602] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:38.932995 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c01161-94db-44d4-b326-f723fd935ec9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:38.943739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c01161-94db-44d4-b326-f723fd935ec9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:38.954543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 797/1603] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:38 2022] PUT /identity/v3/projects/f8e7b818f3a74fc48f0faeeb3398069a/users/efc23cbdbebc423baed1a2cb6c6cd7e7/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:38.954543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a597a4-b115-4019-8d50-6cf551503495 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:38.954543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a597a4-b115-4019-8d50-6cf551503495 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:38.954543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a597a4-b115-4019-8d50-6cf551503495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:38.996839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d8a597a4-b115-4019-8d50-6cf551503495 None None] MFA Rules not processed for user `cd48fac53626402192e203cf80cfc22f`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:38.998361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d8a597a4-b115-4019-8d50-6cf551503495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:39.018929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8d1b3-e6b1-4b89-baa6-39aa25d37b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:39.020156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8d1b3-e6b1-4b89-baa6-39aa25d37b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.029082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8d1b3-e6b1-4b89-baa6-39aa25d37b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.029082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8d1b3-e6b1-4b89-baa6-39aa25d37b4e admin admin] PATH_INFO: `/v3/projects/7123f57c394d4a35b46f5bf62d48abb7/users/af2ddeccca5547bfa8ad3804e9041b65/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.040351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8d1b3-e6b1-4b89-baa6-39aa25d37b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7123f57c394d4a35b46f5bf62d48abb7, user_id=af2ddeccca5547bfa8ad3804e9041b65, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:39.056711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8d1b3-e6b1-4b89-baa6-39aa25d37b4e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:39.083870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 798/1604] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:39.085095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a597a4-b115-4019-8d50-6cf551503495 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:39.100184 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a597a4-b115-4019-8d50-6cf551503495 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:39.106061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5471743-0935-4fd8-bc96-d5ccd5e9742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:39.107239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5471743-0935-4fd8-bc96-d5ccd5e9742b admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.107598 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5471743-0935-4fd8-bc96-d5ccd5e9742b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.108051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5471743-0935-4fd8-bc96-d5ccd5e9742b admin admin] PATH_INFO: `/v3/projects/6c34f44042ac43cc8a6a7937c0683120/users/57f36ff6dbd24787baf10788bdf8a1f4/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.123957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5471743-0935-4fd8-bc96-d5ccd5e9742b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c34f44042ac43cc8a6a7937c0683120, user_id=57f36ff6dbd24787baf10788bdf8a1f4, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:39.127314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5471743-0935-4fd8-bc96-d5ccd5e9742b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:39.146458 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 807/1605] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:38 2022] PUT /identity/v3/projects/7123f57c394d4a35b46f5bf62d48abb7/users/af2ddeccca5547bfa8ad3804e9041b65/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:39.147382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8d1b3-e6b1-4b89-baa6-39aa25d37b4e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:39.206101 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8d1b3-e6b1-4b89-baa6-39aa25d37b4e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:39.210860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37200-ba23-4f6f-80f9-7cbbabafc8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:39.211780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37200-ba23-4f6f-80f9-7cbbabafc8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.212099 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37200-ba23-4f6f-80f9-7cbbabafc8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.212395 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37200-ba23-4f6f-80f9-7cbbabafc8dc admin admin] PATH_INFO: `/v3/projects/f2ad6b80d4e64431aea1f48de4aa5548/users/5ceb047e6d0b46279f54e507fd53b7f9/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.228112 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e37200-ba23-4f6f-80f9-7cbbabafc8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ad6b80d4e64431aea1f48de4aa5548, user_id=5ceb047e6d0b46279f54e507fd53b7f9, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:39.230884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e37200-ba23-4f6f-80f9-7cbbabafc8dc admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:39.263252 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 799/1606] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:39 2022] PUT /identity/v3/projects/6c34f44042ac43cc8a6a7937c0683120/users/57f36ff6dbd24787baf10788bdf8a1f4/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:39.264159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5471743-0935-4fd8-bc96-d5ccd5e9742b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:39.329171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5471743-0935-4fd8-bc96-d5ccd5e9742b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:39.341220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e8981-1e11-415e-a7df-ad69d1e14265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:39.342442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e8981-1e11-415e-a7df-ad69d1e14265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.342732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e8981-1e11-415e-a7df-ad69d1e14265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.343013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e8981-1e11-415e-a7df-ad69d1e14265 admin admin] PATH_INFO: `/v3/projects/cae8d0353d3c471e98971c6cff149bf5/users/4543ac206ae4420eb926127d14e2877b/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.367874 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e8981-1e11-415e-a7df-ad69d1e14265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae8d0353d3c471e98971c6cff149bf5, user_id=4543ac206ae4420eb926127d14e2877b, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:39.368547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e8981-1e11-415e-a7df-ad69d1e14265 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:39.369087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 808/1607] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:39 2022] PUT /identity/v3/projects/f2ad6b80d4e64431aea1f48de4aa5548/users/5ceb047e6d0b46279f54e507fd53b7f9/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:39.370762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5779186-ddff-486f-902d-cf4aa09f38fa None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.371344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5779186-ddff-486f-902d-cf4aa09f38fa None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.371344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5779186-ddff-486f-902d-cf4aa09f38fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.389474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f5779186-ddff-486f-902d-cf4aa09f38fa None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:39.391631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f5779186-ddff-486f-902d-cf4aa09f38fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:39.450066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 809/1608] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:39.452083 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c77ff2-0d84-4f33-b573-0a7ce824d785 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.452482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c77ff2-0d84-4f33-b573-0a7ce824d785 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.452906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c77ff2-0d84-4f33-b573-0a7ce824d785 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.454287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 810/1609] 10.222.0.64 () {54 vars in 961 bytes} [Fri May 13 17:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:26:39.455404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ca14-e545-4d4b-ac38-67a38121a59a None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.455693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ca14-e545-4d4b-ac38-67a38121a59a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.456033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ca14-e545-4d4b-ac38-67a38121a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.471937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 800/1610] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:39 2022] PUT /identity/v3/projects/cae8d0353d3c471e98971c6cff149bf5/users/4543ac206ae4420eb926127d14e2877b/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:39.473401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef4ea6-6c16-476b-97b3-7d138f5bdcf4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.473785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef4ea6-6c16-476b-97b3-7d138f5bdcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.474163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef4ea6-6c16-476b-97b3-7d138f5bdcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.482779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a470ca14-e545-4d4b-ac38-67a38121a59a None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:39.488277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a470ca14-e545-4d4b-ac38-67a38121a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:39.497718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1bef4ea6-6c16-476b-97b3-7d138f5bdcf4 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:39.498924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1bef4ea6-6c16-476b-97b3-7d138f5bdcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:39.548203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 811/1611] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:39.549822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840f097-2aca-4d4f-b63f-6d383379d725 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.550170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840f097-2aca-4d4f-b63f-6d383379d725 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.550538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840f097-2aca-4d4f-b63f-6d383379d725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.564268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 801/1612] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:39.565136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef4ea6-6c16-476b-97b3-7d138f5bdcf4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:39.567049 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1bef4ea6-6c16-476b-97b3-7d138f5bdcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:39.581418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f840f097-2aca-4d4f-b63f-6d383379d725 None None] MFA Rules not processed for user `5ceb047e6d0b46279f54e507fd53b7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:39.582947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f840f097-2aca-4d4f-b63f-6d383379d725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:39.631076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef4ea6-6c16-476b-97b3-7d138f5bdcf4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:39.634994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97775078-723d-4e0d-8d7c-281627cac9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:39.635679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97775078-723d-4e0d-8d7c-281627cac9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.635962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97775078-723d-4e0d-8d7c-281627cac9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.636236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97775078-723d-4e0d-8d7c-281627cac9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.649895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97775078-723d-4e0d-8d7c-281627cac9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:39.658088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97775078-723d-4e0d-8d7c-281627cac9a7 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:39.658415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 812/1613] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:39.658415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa71be4-93d0-4c5d-a6ca-a8d42f3d67f2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.658415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa71be4-93d0-4c5d-a6ca-a8d42f3d67f2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.658415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa71be4-93d0-4c5d-a6ca-a8d42f3d67f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.666132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 802/1614] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:39.667352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f84e65-10d0-45bc-8adf-ca506d38d8c8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.667631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f84e65-10d0-45bc-8adf-ca506d38d8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.667907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f84e65-10d0-45bc-8adf-ca506d38d8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.698587 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-bfa71be4-93d0-4c5d-a6ca-a8d42f3d67f2 None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:39.699987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-bfa71be4-93d0-4c5d-a6ca-a8d42f3d67f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:39.726902 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c6f84e65-10d0-45bc-8adf-ca506d38d8c8 None None] MFA Rules not processed for user `4543ac206ae4420eb926127d14e2877b`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:39.726902 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c6f84e65-10d0-45bc-8adf-ca506d38d8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:39.783407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 813/1615] 10.222.0.64 () {58 vars in 1058 bytes} [Fri May 13 17:26:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:39.784056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa71be4-93d0-4c5d-a6ca-a8d42f3d67f2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:39.793070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa71be4-93d0-4c5d-a6ca-a8d42f3d67f2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:39.798693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ef15c-25b9-4e80-b1cc-7d8740d415da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:39.799621 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef15c-25b9-4e80-b1cc-7d8740d415da service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.799916 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef15c-25b9-4e80-b1cc-7d8740d415da service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.800193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef15c-25b9-4e80-b1cc-7d8740d415da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.801020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 803/1616] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:39.802054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f84e65-10d0-45bc-8adf-ca506d38d8c8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:39.811335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ef15c-25b9-4e80-b1cc-7d8740d415da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:39.812913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ef15c-25b9-4e80-b1cc-7d8740d415da service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:39.814040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f84e65-10d0-45bc-8adf-ca506d38d8c8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:39.819163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c40995-6171-42b9-ac85-504b1723ca4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:39.819758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c40995-6171-42b9-ac85-504b1723ca4f service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.820101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c40995-6171-42b9-ac85-504b1723ca4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.820442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c40995-6171-42b9-ac85-504b1723ca4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.830324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c40995-6171-42b9-ac85-504b1723ca4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:39.832061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c40995-6171-42b9-ac85-504b1723ca4f service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:39.833537 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 814/1617] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:39.841538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947cec0-6b80-4175-9f60-cfa9f305ce90 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.841538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947cec0-6b80-4175-9f60-cfa9f305ce90 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.841538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947cec0-6b80-4175-9f60-cfa9f305ce90 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.841538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 815/1618] 10.222.0.64 () {54 vars in 961 bytes} [Fri May 13 17:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:26:39.841538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947cec0-6b80-4175-9f60-cfa9f305ce90 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:39.849654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 804/1619] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:39.850498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c40995-6171-42b9-ac85-504b1723ca4f service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:39.856336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947cec0-6b80-4175-9f60-cfa9f305ce90 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:39.861849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c40995-6171-42b9-ac85-504b1723ca4f service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:39.863243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eadce5-e363-440c-a61a-139ec02b52c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:39.864165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eadce5-e363-440c-a61a-139ec02b52c8 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.864737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eadce5-e363-440c-a61a-139ec02b52c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.865562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eadce5-e363-440c-a61a-139ec02b52c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.866985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa129ca9-a908-4d93-ab2a-0bbaf82a73bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:39.867673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa129ca9-a908-4d93-ab2a-0bbaf82a73bc admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.867963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa129ca9-a908-4d93-ab2a-0bbaf82a73bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.868245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa129ca9-a908-4d93-ab2a-0bbaf82a73bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.870429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa129ca9-a908-4d93-ab2a-0bbaf82a73bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:39.871309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa129ca9-a908-4d93-ab2a-0bbaf82a73bc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:39.951206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eadce5-e363-440c-a61a-139ec02b52c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:39.953065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eadce5-e363-440c-a61a-139ec02b52c8 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:39.963649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 816/1620] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:39.965175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a08f63-a8ca-425b-8039-1a2fd415f828 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:39.965473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a08f63-a8ca-425b-8039-1a2fd415f828 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:39.965793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a08f63-a8ca-425b-8039-1a2fd415f828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:39.989881 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-53a08f63-a8ca-425b-8039-1a2fd415f828 None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:39.989881 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-53a08f63-a8ca-425b-8039-1a2fd415f828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:40.021031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 817/1621] 10.222.0.64 () {58 vars in 1058 bytes} [Fri May 13 17:26:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:40.022500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a08f63-a8ca-425b-8039-1a2fd415f828 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:40.035835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 805/1622] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:26:39 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:40.039921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa129ca9-a908-4d93-ab2a-0bbaf82a73bc admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:40.050343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a08f63-a8ca-425b-8039-1a2fd415f828 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:40.166338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa129ca9-a908-4d93-ab2a-0bbaf82a73bc admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:40.174968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471ffa2-ced2-4b55-a677-4ffe561eb1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:40.175823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471ffa2-ced2-4b55-a677-4ffe561eb1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.176253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471ffa2-ced2-4b55-a677-4ffe561eb1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.176638 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471ffa2-ced2-4b55-a677-4ffe561eb1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.177496 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471ffa2-ced2-4b55-a677-4ffe561eb1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:40.180165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471ffa2-ced2-4b55-a677-4ffe561eb1d3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:40.183415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d0637-4049-4939-a6a8-c373987fe7eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:40.184566 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d0637-4049-4939-a6a8-c373987fe7eb service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.185048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d0637-4049-4939-a6a8-c373987fe7eb service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.185488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d0637-4049-4939-a6a8-c373987fe7eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.272016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d0637-4049-4939-a6a8-c373987fe7eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:40.273831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d0637-4049-4939-a6a8-c373987fe7eb service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:40.275507 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 806/1623] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:26:40 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:26:40.278877 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471ffa2-ced2-4b55-a677-4ffe561eb1d3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:40.297460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 818/1624] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:40.299017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471ffa2-ced2-4b55-a677-4ffe561eb1d3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:40.314348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4f975-b0e8-4bf4-82f3-a9a20bf02058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:40.314348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4f975-b0e8-4bf4-82f3-a9a20bf02058 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.314348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4f975-b0e8-4bf4-82f3-a9a20bf02058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.314348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4f975-b0e8-4bf4-82f3-a9a20bf02058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.315013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4f975-b0e8-4bf4-82f3-a9a20bf02058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:40.316018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4f975-b0e8-4bf4-82f3-a9a20bf02058 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:40.342923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 807/1625] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:40.343294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d0637-4049-4939-a6a8-c373987fe7eb service nova] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:40.369971 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d0637-4049-4939-a6a8-c373987fe7eb service nova] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:40.387935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9ede4-f5ac-4210-b890-aac0102b509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:40.388856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9ede4-f5ac-4210-b890-aac0102b509d admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.389154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9ede4-f5ac-4210-b890-aac0102b509d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.389415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9ede4-f5ac-4210-b890-aac0102b509d admin admin] PATH_INFO: `/v3/projects/ac37247315d14e31a08a3b77ebc90661/users/dec25bf36f124ab48eca7522b168c5f9/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.453915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9ede4-f5ac-4210-b890-aac0102b509d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac37247315d14e31a08a3b77ebc90661, user_id=dec25bf36f124ab48eca7522b168c5f9, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:40.454569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07c61-ed18-49bd-a126-1e9e8dd6c84b None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.454867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07c61-ed18-49bd-a126-1e9e8dd6c84b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.455213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07c61-ed18-49bd-a126-1e9e8dd6c84b None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.456700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 808/1626] 10.222.0.64 () {54 vars in 912 bytes} [Fri May 13 17:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:26:40.456955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9ede4-f5ac-4210-b890-aac0102b509d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:40.466317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811a5da-a4f2-4fe0-b16a-95580c1fe22e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.466748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811a5da-a4f2-4fe0-b16a-95580c1fe22e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.467429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811a5da-a4f2-4fe0-b16a-95580c1fe22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.496013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6811a5da-a4f2-4fe0-b16a-95580c1fe22e None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:40.497284 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6811a5da-a4f2-4fe0-b16a-95580c1fe22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:40.514657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 809/1627] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:26:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:40.554532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811a5da-a4f2-4fe0-b16a-95580c1fe22e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:40.565331 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 819/1628] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:40 2022] PUT /identity/v3/projects/ac37247315d14e31a08a3b77ebc90661/users/dec25bf36f124ab48eca7522b168c5f9/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:40.568974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9ede4-f5ac-4210-b890-aac0102b509d admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:40.653635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811a5da-a4f2-4fe0-b16a-95580c1fe22e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:40.684189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9ede4-f5ac-4210-b890-aac0102b509d admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:40.691144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17aed2-eb3e-4663-a22a-81a69c9e3ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:40.691947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17aed2-eb3e-4663-a22a-81a69c9e3ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.692499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17aed2-eb3e-4663-a22a-81a69c9e3ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.692881 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17aed2-eb3e-4663-a22a-81a69c9e3ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.693749 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17aed2-eb3e-4663-a22a-81a69c9e3ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:40.695584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17aed2-eb3e-4663-a22a-81a69c9e3ec9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:40.719172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 820/1629] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:40.720614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074832-917c-4303-9a69-b641d5c956e9 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.721139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074832-917c-4303-9a69-b641d5c956e9 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.721392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074832-917c-4303-9a69-b641d5c956e9 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.723092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 821/1630] 10.222.0.64 () {54 vars in 912 bytes} [Fri May 13 17:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:26:40.724008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb074832-917c-4303-9a69-b641d5c956e9 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:40.738674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb074832-917c-4303-9a69-b641d5c956e9 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:40.747845 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b41126-fe9e-4732-94f5-6dbb1ac05006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:40.749451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b41126-fe9e-4732-94f5-6dbb1ac05006 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.750144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b41126-fe9e-4732-94f5-6dbb1ac05006 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.751016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735e4ac-4f21-42e1-802c-d6dba74a628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:40.752199 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735e4ac-4f21-42e1-802c-d6dba74a628e admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.752199 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735e4ac-4f21-42e1-802c-d6dba74a628e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.752689 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b41126-fe9e-4732-94f5-6dbb1ac05006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.753945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735e4ac-4f21-42e1-802c-d6dba74a628e admin admin] PATH_INFO: `/v3/projects/ac37247315d14e31a08a3b77ebc90661/users/dec25bf36f124ab48eca7522b168c5f9/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.757167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735e4ac-4f21-42e1-802c-d6dba74a628e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac37247315d14e31a08a3b77ebc90661, user_id=dec25bf36f124ab48eca7522b168c5f9, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:40.770116 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735e4ac-4f21-42e1-802c-d6dba74a628e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:40.801360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 822/1631] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:40 2022] PUT /identity/v3/projects/ac37247315d14e31a08a3b77ebc90661/users/dec25bf36f124ab48eca7522b168c5f9/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:40.801360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ff2c9-549e-4c7c-9d3e-05dbc14ae6d2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.801360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ff2c9-549e-4c7c-9d3e-05dbc14ae6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.801360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ff2c9-549e-4c7c-9d3e-05dbc14ae6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.826525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-085ff2c9-549e-4c7c-9d3e-05dbc14ae6d2 None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:40.830166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-085ff2c9-549e-4c7c-9d3e-05dbc14ae6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:40.849406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b41126-fe9e-4732-94f5-6dbb1ac05006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:40.852371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b41126-fe9e-4732-94f5-6dbb1ac05006 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:40.883968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 810/1632] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:26:40.887646 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae97072-b52d-4057-9f2e-b739d11a88a1 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:40.891219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae97072-b52d-4057-9f2e-b739d11a88a1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:40.891219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae97072-b52d-4057-9f2e-b739d11a88a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:40.961888 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5ae97072-b52d-4057-9f2e-b739d11a88a1 None None] MFA Rules not processed for user `dec25bf36f124ab48eca7522b168c5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:40.963928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5ae97072-b52d-4057-9f2e-b739d11a88a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:41.013243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 823/1633] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:26:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:41.055996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ff2c9-549e-4c7c-9d3e-05dbc14ae6d2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:41.149063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 811/1634] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:41.157347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ff2c9-549e-4c7c-9d3e-05dbc14ae6d2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:41.161487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c86f9-daab-4555-aa3a-9c0fcaabf43a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:41.162164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c86f9-daab-4555-aa3a-9c0fcaabf43a service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:41.162455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c86f9-daab-4555-aa3a-9c0fcaabf43a service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:41.162738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c86f9-daab-4555-aa3a-9c0fcaabf43a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:41.174902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c86f9-daab-4555-aa3a-9c0fcaabf43a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:41.176469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c86f9-daab-4555-aa3a-9c0fcaabf43a service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:41.189351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 824/1635] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:26:41.278354 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae97072-b52d-4057-9f2e-b739d11a88a1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:41.279407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c86f9-daab-4555-aa3a-9c0fcaabf43a service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:41.290736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c86f9-daab-4555-aa3a-9c0fcaabf43a service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:41.295295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c529f-8771-4c2a-a243-b095f760db6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:41.297620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c529f-8771-4c2a-a243-b095f760db6f service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:41.298099 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c529f-8771-4c2a-a243-b095f760db6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:41.298622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c529f-8771-4c2a-a243-b095f760db6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:41.336904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c529f-8771-4c2a-a243-b095f760db6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:41.339834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c529f-8771-4c2a-a243-b095f760db6f service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:41.367321 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 825/1636] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:26:41.414269 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae97072-b52d-4057-9f2e-b739d11a88a1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:41.419796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:41.420921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:41.421203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:41.422062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] PATH_INFO: `/v3/users/cd48fac53626402192e203cf80cfc22f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:41.423545 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd48fac53626402192e203cf80cfc22f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:41.424800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 17:26:41.424800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: warnings.warn(msg) May 13 17:26:41.424800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: May 13 17:26:41.425735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:41.713382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd48fac53626402192e203cf80cfc22f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:41.768797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c529f-8771-4c2a-a243-b095f760db6f service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:41.779229 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd48fac53626402192e203cf80cfc22f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:41.781040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c529f-8771-4c2a-a243-b095f760db6f service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:41.786990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868d9b5-d2dd-48b7-b3ed-1a67d89e13ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:41.787710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d9b5-d2dd-48b7-b3ed-1a67d89e13ce service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:41.788200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d9b5-d2dd-48b7-b3ed-1a67d89e13ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:41.788499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d9b5-d2dd-48b7-b3ed-1a67d89e13ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:41.819014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd48fac53626402192e203cf80cfc22f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:41.819878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd48fac53626402192e203cf80cfc22f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:41.918014 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868d9b5-d2dd-48b7-b3ed-1a67d89e13ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:41.919944 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868d9b5-d2dd-48b7-b3ed-1a67d89e13ce service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:41.924334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3c18a3dd-6f57-4a9b-9e4f-60cdbff1cc84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd48fac53626402192e203cf80cfc22f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:41.931460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 826/1637] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:26:41.933469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 812/1638] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:26:41 2022] DELETE /identity/v3/users/cd48fac53626402192e203cf80cfc22f => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:41.943015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfd75d-42f8-484a-be64-6b728a4c3c0c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:41.943328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfd75d-42f8-484a-be64-6b728a4c3c0c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:41.943774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfd75d-42f8-484a-be64-6b728a4c3c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:41.949007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222f38-43cd-4be7-932d-5c0c73ed69d0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:41.955820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222f38-43cd-4be7-932d-5c0c73ed69d0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:41.958715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222f38-43cd-4be7-932d-5c0c73ed69d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:41.973919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-8ebfd75d-42f8-484a-be64-6b728a4c3c0c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:41.976780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8ebfd75d-42f8-484a-be64-6b728a4c3c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:42.002498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c0222f38-43cd-4be7-932d-5c0c73ed69d0 None None] MFA Rules not processed for user `af2ddeccca5547bfa8ad3804e9041b65`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:42.004197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c0222f38-43cd-4be7-932d-5c0c73ed69d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:42.093587 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 827/1639] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:42.114067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfd75d-42f8-484a-be64-6b728a4c3c0c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:42.117739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8ebfd75d-42f8-484a-be64-6b728a4c3c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:42.180626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 813/1640] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:26:42.188383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66c5e-8993-482d-8574-5435e55ac068 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:42.188678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66c5e-8993-482d-8574-5435e55ac068 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:42.189051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66c5e-8993-482d-8574-5435e55ac068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:42.235561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6ce66c5e-8993-482d-8574-5435e55ac068 None None] MFA Rules not processed for user `af2ddeccca5547bfa8ad3804e9041b65`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:42.237469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6ce66c5e-8993-482d-8574-5435e55ac068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:42.257150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 814/1641] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:26:42.271829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66c5e-8993-482d-8574-5435e55ac068 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:42.273480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6ce66c5e-8993-482d-8574-5435e55ac068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:42.323853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfd75d-42f8-484a-be64-6b728a4c3c0c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:42.333317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61729e62-1662-4316-adad-9f9f29f5742d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:42.334224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61729e62-1662-4316-adad-9f9f29f5742d service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:42.334663 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61729e62-1662-4316-adad-9f9f29f5742d service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:42.335090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61729e62-1662-4316-adad-9f9f29f5742d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:42.358136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61729e62-1662-4316-adad-9f9f29f5742d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:42.365188 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61729e62-1662-4316-adad-9f9f29f5742d service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:42.405255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 828/1642] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:42.554846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66c5e-8993-482d-8574-5435e55ac068 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:42.570035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe508d3-c873-4f98-89b5-31e761f23188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:42.571075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe508d3-c873-4f98-89b5-31e761f23188 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:42.571547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe508d3-c873-4f98-89b5-31e761f23188 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:42.572008 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe508d3-c873-4f98-89b5-31e761f23188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:42.587074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe508d3-c873-4f98-89b5-31e761f23188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:42.588753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe508d3-c873-4f98-89b5-31e761f23188 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:42.620866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 815/1643] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:43.798583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3cf04-9f62-4360-a862-6bc1fff5f6be None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:43.798583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3cf04-9f62-4360-a862-6bc1fff5f6be None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:43.798583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3cf04-9f62-4360-a862-6bc1fff5f6be None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:43.798583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 829/1644] 10.222.0.64 () {54 vars in 912 bytes} [Fri May 13 17:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:26:43.803439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86a78f-07c6-4570-a900-2984a25d68e2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:43.803439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86a78f-07c6-4570-a900-2984a25d68e2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:43.803439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86a78f-07c6-4570-a900-2984a25d68e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:43.803439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-eb86a78f-07c6-4570-a900-2984a25d68e2 None None] MFA Rules not processed for user `d99855838f77462886cc87db440e1037`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:43.803439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-eb86a78f-07c6-4570-a900-2984a25d68e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:43.803439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 816/1645] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:26:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:26:43.805303 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3cf04-9f62-4360-a862-6bc1fff5f6be None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:43.824293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3cf04-9f62-4360-a862-6bc1fff5f6be None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:43.835758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b4676-8a05-4222-b0b0-a198f6ee3050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:43.853491 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b4676-8a05-4222-b0b0-a198f6ee3050 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:43.853491 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b4676-8a05-4222-b0b0-a198f6ee3050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:43.853491 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b4676-8a05-4222-b0b0-a198f6ee3050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:43.862105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b4676-8a05-4222-b0b0-a198f6ee3050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:43.863953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b4676-8a05-4222-b0b0-a198f6ee3050 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:43.876882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 830/1646] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:44.461201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86a78f-07c6-4570-a900-2984a25d68e2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:44.462692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-eb86a78f-07c6-4570-a900-2984a25d68e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:44.488434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86a78f-07c6-4570-a900-2984a25d68e2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:44.497383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:44.500505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:44.500988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:44.502414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] PATH_INFO: `/v3/projects/21feba785ece4f3fb703519584e760f7` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:44.504495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=21feba785ece4f3fb703519584e760f7)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:44.508329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:44.714732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21feba785ece4f3fb703519584e760f7', 'request_id': 'req-21a21e72-8f1c-4abe-8caf-095265fc35ad'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:44.739863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21feba785ece4f3fb703519584e760f7', 'request_id': 'req-21a21e72-8f1c-4abe-8caf-095265fc35ad'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:44.841922 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21feba785ece4f3fb703519584e760f7', 'request_id': 'req-21a21e72-8f1c-4abe-8caf-095265fc35ad'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:44.867022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] The token cache is being invalidate because project 21feba785ece4f3fb703519584e760f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:26:44.872424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:44.874553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21a21e72-8f1c-4abe-8caf-095265fc35ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:44.880217 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 817/1647] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:26:44 2022] DELETE /identity/v3/projects/21feba785ece4f3fb703519584e760f7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:44.881788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f45b9a-67ff-4af7-a25a-0e33dd710816 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:44.882311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f45b9a-67ff-4af7-a25a-0e33dd710816 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:44.882908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f45b9a-67ff-4af7-a25a-0e33dd710816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:44.926050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d7f45b9a-67ff-4af7-a25a-0e33dd710816 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:44.928746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d7f45b9a-67ff-4af7-a25a-0e33dd710816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:45.111100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 831/1648] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:45.117202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f62dec-c04d-47f4-a4e1-40d87741a4eb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:45.117961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f62dec-c04d-47f4-a4e1-40d87741a4eb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:45.118674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f62dec-c04d-47f4-a4e1-40d87741a4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:45.158810 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a1f62dec-c04d-47f4-a4e1-40d87741a4eb None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:45.175845 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a1f62dec-c04d-47f4-a4e1-40d87741a4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:45.197073 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f45b9a-67ff-4af7-a25a-0e33dd710816 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:45.197487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 818/1649] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:45.213089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f45b9a-67ff-4af7-a25a-0e33dd710816 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:45.222266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72480ac-9bd6-42e9-9300-ea104a11ded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:45.222985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72480ac-9bd6-42e9-9300-ea104a11ded4 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:45.223298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72480ac-9bd6-42e9-9300-ea104a11ded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:45.225916 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72480ac-9bd6-42e9-9300-ea104a11ded4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:45.226713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72480ac-9bd6-42e9-9300-ea104a11ded4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:26:45.231937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72480ac-9bd6-42e9-9300-ea104a11ded4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:45.234992 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72480ac-9bd6-42e9-9300-ea104a11ded4 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:45.261322 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 832/1650] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:26:45.266130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f62dec-c04d-47f4-a4e1-40d87741a4eb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:45.280575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f62dec-c04d-47f4-a4e1-40d87741a4eb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:45.290218 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa2c8a-a9ee-41eb-b779-40f33be62926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:45.291193 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa2c8a-a9ee-41eb-b779-40f33be62926 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:45.291534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa2c8a-a9ee-41eb-b779-40f33be62926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:45.292500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa2c8a-a9ee-41eb-b779-40f33be62926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:45.293419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa2c8a-a9ee-41eb-b779-40f33be62926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:45.295616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa2c8a-a9ee-41eb-b779-40f33be62926 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:45.385936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 819/1651] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:26:45 2022] POST /identity/v3/projects => generated 403 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:45.390697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72480ac-9bd6-42e9-9300-ea104a11ded4 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:45.403632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72480ac-9bd6-42e9-9300-ea104a11ded4 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:45.528490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bd431-b6af-43ac-8bfe-4999b317f251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:45.529821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd431-b6af-43ac-8bfe-4999b317f251 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:45.530167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd431-b6af-43ac-8bfe-4999b317f251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:45.531507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd431-b6af-43ac-8bfe-4999b317f251 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:45.532255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bd431-b6af-43ac-8bfe-4999b317f251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:45.535854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bd431-b6af-43ac-8bfe-4999b317f251 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:45.659393 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00686f7d-f362-4d1a-af27-a8a5be2af460 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:45.659984 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00686f7d-f362-4d1a-af27-a8a5be2af460 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:45.660381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00686f7d-f362-4d1a-af27-a8a5be2af460 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:45.662407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 820/1652] 10.222.0.64 () {54 vars in 960 bytes} [Fri May 13 17:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:26:45.663361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00686f7d-f362-4d1a-af27-a8a5be2af460 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:45.669647 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 833/1653] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:26:45 2022] POST /identity/v3/users => generated 302 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:45.678244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83887a9-08e3-4cc4-bbc6-9f8979227326 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:45.678542 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83887a9-08e3-4cc4-bbc6-9f8979227326 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:45.678823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83887a9-08e3-4cc4-bbc6-9f8979227326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:45.699386 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00686f7d-f362-4d1a-af27-a8a5be2af460 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:45.721576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8ab76-f427-4aaf-9913-595a99f1db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:45.721576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ab76-f427-4aaf-9913-595a99f1db36 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:45.721576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ab76-f427-4aaf-9913-595a99f1db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:45.721576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ab76-f427-4aaf-9913-595a99f1db36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:45.721814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8ab76-f427-4aaf-9913-595a99f1db36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:45.721814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8ab76-f427-4aaf-9913-595a99f1db36 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:45.724270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c83887a9-08e3-4cc4-bbc6-9f8979227326 None None] MFA Rules not processed for user `b84ae21424694df68a96b928e15e9240`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:45.728836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c83887a9-08e3-4cc4-bbc6-9f8979227326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:45.738214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 821/1654] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:45.743919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8ab76-f427-4aaf-9913-595a99f1db36 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:45.783067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8ab76-f427-4aaf-9913-595a99f1db36 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:45.813103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d349b4d-79dc-4107-b1a2-bc7f41add7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:45.813798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d349b4d-79dc-4107-b1a2-bc7f41add7da admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:45.814078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d349b4d-79dc-4107-b1a2-bc7f41add7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:45.814820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d349b4d-79dc-4107-b1a2-bc7f41add7da admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:45.815897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d349b4d-79dc-4107-b1a2-bc7f41add7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:45.817575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d349b4d-79dc-4107-b1a2-bc7f41add7da admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:45.852093 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 822/1655] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:45.853126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d349b4d-79dc-4107-b1a2-bc7f41add7da admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:45.894669 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d349b4d-79dc-4107-b1a2-bc7f41add7da admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:45.915945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 834/1656] 10.222.0.64 () {58 vars in 1057 bytes} [Fri May 13 17:26:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:26:45.925268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f6814-c4b0-421c-8831-c6b46ebf11d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:45.925654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83887a9-08e3-4cc4-bbc6-9f8979227326 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:45.926735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f6814-c4b0-421c-8831-c6b46ebf11d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:45.927506 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f6814-c4b0-421c-8831-c6b46ebf11d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:45.928070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f6814-c4b0-421c-8831-c6b46ebf11d8 admin admin] PATH_INFO: `/v3/projects/6e2af938bef24636b081da69f3f42432/users/84bac7bc750a40a9a68f9b027bc0d048/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:45.964708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83887a9-08e3-4cc4-bbc6-9f8979227326 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:45.973640 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f6814-c4b0-421c-8831-c6b46ebf11d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2af938bef24636b081da69f3f42432, user_id=84bac7bc750a40a9a68f9b027bc0d048, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:45.979587 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f6814-c4b0-421c-8831-c6b46ebf11d8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:46.000997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78358423-dc55-4f3a-84ab-49bfa9f87065 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84ae21424694df68a96b928e15e9240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:46.002213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78358423-dc55-4f3a-84ab-49bfa9f87065 service placement] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:46.003518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78358423-dc55-4f3a-84ab-49bfa9f87065 service placement] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:46.004660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78358423-dc55-4f3a-84ab-49bfa9f87065 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:46.013908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-78358423-dc55-4f3a-84ab-49bfa9f87065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:46.059795 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78358423-dc55-4f3a-84ab-49bfa9f87065 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:46.065134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78358423-dc55-4f3a-84ab-49bfa9f87065 service placement] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:46.113422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 835/1657] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:46.125962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 823/1658] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:45 2022] PUT /identity/v3/projects/6e2af938bef24636b081da69f3f42432/users/84bac7bc750a40a9a68f9b027bc0d048/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:46.133317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed2353-ca32-4755-8d27-aa17d01a7697 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:46.133716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed2353-ca32-4755-8d27-aa17d01a7697 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:46.134057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed2353-ca32-4755-8d27-aa17d01a7697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:46.181330 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-beed2353-ca32-4755-8d27-aa17d01a7697 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:46.183377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-beed2353-ca32-4755-8d27-aa17d01a7697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:46.331472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 836/1659] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:46.354091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f6814-c4b0-421c-8831-c6b46ebf11d8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:46.355943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e64f6814-c4b0-421c-8831-c6b46ebf11d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:46.587090 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f6814-c4b0-421c-8831-c6b46ebf11d8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:46.597837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ebebc-0820-43cc-b390-a951030cf4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:46.601781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebebc-0820-43cc-b390-a951030cf4ac service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:46.602373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebebc-0820-43cc-b390-a951030cf4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:46.603154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ebebc-0820-43cc-b390-a951030cf4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:46.632825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ebebc-0820-43cc-b390-a951030cf4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:46.634878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ebebc-0820-43cc-b390-a951030cf4ac service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:46.673438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 824/1660] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:50.280561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64f44-24d2-483e-a8d9-254910076884 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:50.281689 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64f44-24d2-483e-a8d9-254910076884 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:50.281791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64f44-24d2-483e-a8d9-254910076884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:50.323823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-beb64f44-24d2-483e-a8d9-254910076884 None None] MFA Rules not processed for user `84bac7bc750a40a9a68f9b027bc0d048`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:50.326996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-beb64f44-24d2-483e-a8d9-254910076884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:50.344481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051a8b6-0699-4d4b-bd40-7cdbecea0aa3 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:50.345133 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051a8b6-0699-4d4b-bd40-7cdbecea0aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:50.346467 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051a8b6-0699-4d4b-bd40-7cdbecea0aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:50.385503 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0051a8b6-0699-4d4b-bd40-7cdbecea0aa3 None None] MFA Rules not processed for user `57f36ff6dbd24787baf10788bdf8a1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:50.387256 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0051a8b6-0699-4d4b-bd40-7cdbecea0aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:50.475789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 837/1661] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:50.477145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64f44-24d2-483e-a8d9-254910076884 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:50.503024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64f44-24d2-483e-a8d9-254910076884 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:50.517964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376feb97-e9c1-419a-ba69-c027474e4bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:50.519093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376feb97-e9c1-419a-ba69-c027474e4bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:50.519093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376feb97-e9c1-419a-ba69-c027474e4bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:50.523254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376feb97-e9c1-419a-ba69-c027474e4bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:50.524534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376feb97-e9c1-419a-ba69-c027474e4bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:50.536797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376feb97-e9c1-419a-ba69-c027474e4bfe admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:50.547900 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 825/1662] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:26:50.561045 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051a8b6-0699-4d4b-bd40-7cdbecea0aa3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:50.565606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0051a8b6-0699-4d4b-bd40-7cdbecea0aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:50.680691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 838/1663] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:26:50 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:26:50.685756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376feb97-e9c1-419a-ba69-c027474e4bfe admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:50.760304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051a8b6-0699-4d4b-bd40-7cdbecea0aa3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:50.829416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376feb97-e9c1-419a-ba69-c027474e4bfe admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:50.839689 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79c0ec-bbd2-45cd-8676-be5e37feff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:50.840770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c0ec-bbd2-45cd-8676-be5e37feff61 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:50.848391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c0ec-bbd2-45cd-8676-be5e37feff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:50.849001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c0ec-bbd2-45cd-8676-be5e37feff61 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:50.849973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79c0ec-bbd2-45cd-8676-be5e37feff61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:50.854192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79c0ec-bbd2-45cd-8676-be5e37feff61 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:50.880941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b371-e474-4c5e-850d-1dc5476208a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:50.880941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b371-e474-4c5e-850d-1dc5476208a1 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:50.880941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b371-e474-4c5e-850d-1dc5476208a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:50.882226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b371-e474-4c5e-850d-1dc5476208a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:51.000592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 839/1664] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:26:50 2022] POST /identity/v3/users => generated 309 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:26:51.004221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79c0ec-bbd2-45cd-8676-be5e37feff61 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:51.021838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79c0ec-bbd2-45cd-8676-be5e37feff61 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:51.024473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1b371-e474-4c5e-850d-1dc5476208a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:51.026561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1b371-e474-4c5e-850d-1dc5476208a1 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:51.029098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85242f1-f2de-4504-a89e-a1567c80dc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:51.030162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85242f1-f2de-4504-a89e-a1567c80dc2f admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:51.038173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85242f1-f2de-4504-a89e-a1567c80dc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:51.038842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85242f1-f2de-4504-a89e-a1567c80dc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:51.047386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85242f1-f2de-4504-a89e-a1567c80dc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:51.048422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85242f1-f2de-4504-a89e-a1567c80dc2f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:51.061277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 826/1665] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:51.083897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 840/1666] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:51.089795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b371-e474-4c5e-850d-1dc5476208a1 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:51.104410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b371-e474-4c5e-850d-1dc5476208a1 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:51.110373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca40c5-0f79-47c3-8015-2da462432cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:51.111582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca40c5-0f79-47c3-8015-2da462432cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:51.112004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca40c5-0f79-47c3-8015-2da462432cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:51.112420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca40c5-0f79-47c3-8015-2da462432cf6 admin admin] PATH_INFO: `/v3/projects/8531edacdd5b446dba9d77ab0af63d3b/users/5d58095aa7dd499c99be9f8f227abd75/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:51.138297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca40c5-0f79-47c3-8015-2da462432cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8531edacdd5b446dba9d77ab0af63d3b, user_id=5d58095aa7dd499c99be9f8f227abd75, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:51.146611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca40c5-0f79-47c3-8015-2da462432cf6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:51.274297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 827/1667] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:51 2022] PUT /identity/v3/projects/8531edacdd5b446dba9d77ab0af63d3b/users/5d58095aa7dd499c99be9f8f227abd75/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:51.275470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85242f1-f2de-4504-a89e-a1567c80dc2f admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:51.290185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85242f1-f2de-4504-a89e-a1567c80dc2f admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:51.458788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b124a1-166a-4760-974d-ab112733a62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:51.459678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b124a1-166a-4760-974d-ab112733a62c admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:51.459980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b124a1-166a-4760-974d-ab112733a62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:51.460363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b124a1-166a-4760-974d-ab112733a62c admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:51.461338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b124a1-166a-4760-974d-ab112733a62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:51.463114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b124a1-166a-4760-974d-ab112733a62c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:51.485031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 841/1668] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:26:51.489129 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca40c5-0f79-47c3-8015-2da462432cf6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:51.509118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca40c5-0f79-47c3-8015-2da462432cf6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:51.523895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbffbd-0ac4-4cb4-928f-b7b663ba3548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:51.524972 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbffbd-0ac4-4cb4-928f-b7b663ba3548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:51.525313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbffbd-0ac4-4cb4-928f-b7b663ba3548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:51.525532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbffbd-0ac4-4cb4-928f-b7b663ba3548 admin admin] PATH_INFO: `/v3/projects/8531edacdd5b446dba9d77ab0af63d3b/users/5d58095aa7dd499c99be9f8f227abd75/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:51.531440 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbffbd-0ac4-4cb4-928f-b7b663ba3548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8531edacdd5b446dba9d77ab0af63d3b, user_id=5d58095aa7dd499c99be9f8f227abd75, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:51.537021 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbffbd-0ac4-4cb4-928f-b7b663ba3548 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:51.556785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 828/1669] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:26:51 2022] PUT /identity/v3/projects/8531edacdd5b446dba9d77ab0af63d3b/users/5d58095aa7dd499c99be9f8f227abd75/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:26:51.908617 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b87c2-76f5-4515-8427-8dd54a1394a3 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:51.909897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b87c2-76f5-4515-8427-8dd54a1394a3 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:51.910358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b87c2-76f5-4515-8427-8dd54a1394a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:52.003334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-361b87c2-76f5-4515-8427-8dd54a1394a3 None None] MFA Rules not processed for user `dfc52b61bcf845d1953a5a111abb3666`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:52.008678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-361b87c2-76f5-4515-8427-8dd54a1394a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:52.277787 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 842/1670] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:52.294736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbffbd-0ac4-4cb4-928f-b7b663ba3548 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:52.305206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-08dbffbd-0ac4-4cb4-928f-b7b663ba3548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:52.496719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbffbd-0ac4-4cb4-928f-b7b663ba3548 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:52.534296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876e240-d4be-4aba-83df-76a96167a4e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:52.534985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876e240-d4be-4aba-83df-76a96167a4e7 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:52.535302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876e240-d4be-4aba-83df-76a96167a4e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:52.535592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876e240-d4be-4aba-83df-76a96167a4e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:52.582119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876e240-d4be-4aba-83df-76a96167a4e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:52.587357 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876e240-d4be-4aba-83df-76a96167a4e7 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:52.622234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 829/1671] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:26:53.653663 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c120d5d-9920-4ef1-9e50-d87e4ddaeb9a None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:53.654135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c120d5d-9920-4ef1-9e50-d87e4ddaeb9a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:53.659085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c120d5d-9920-4ef1-9e50-d87e4ddaeb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:53.719666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-0c120d5d-9920-4ef1-9e50-d87e4ddaeb9a None None] MFA Rules not processed for user `efc23cbdbebc423baed1a2cb6c6cd7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:53.720951 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0c120d5d-9920-4ef1-9e50-d87e4ddaeb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:53.858292 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 843/1672] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:53.877190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876e240-d4be-4aba-83df-76a96167a4e7 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:53.892968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876e240-d4be-4aba-83df-76a96167a4e7 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:53.900914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f05b27-b3c4-4011-926f-f4bd8911adf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:53.901935 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f05b27-b3c4-4011-926f-f4bd8911adf5 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:53.902476 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f05b27-b3c4-4011-926f-f4bd8911adf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:53.902955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f05b27-b3c4-4011-926f-f4bd8911adf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:53.917918 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f05b27-b3c4-4011-926f-f4bd8911adf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:53.924981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f05b27-b3c4-4011-926f-f4bd8911adf5 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:53.938322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 830/1673] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:26:54.186674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33019a7c-2986-4fd3-8f8b-4d2b5dd4e137 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:54.187011 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33019a7c-2986-4fd3-8f8b-4d2b5dd4e137 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:54.187320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33019a7c-2986-4fd3-8f8b-4d2b5dd4e137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:54.231534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-33019a7c-2986-4fd3-8f8b-4d2b5dd4e137 None None] MFA Rules not processed for user `5d58095aa7dd499c99be9f8f227abd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:54.232943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-33019a7c-2986-4fd3-8f8b-4d2b5dd4e137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:54.369205 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 844/1674] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:54 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:55.939795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ca74c-fdbf-40c9-92f8-2a7c6990a92a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:55.940865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ca74c-fdbf-40c9-92f8-2a7c6990a92a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:55.941612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ca74c-fdbf-40c9-92f8-2a7c6990a92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:56.026313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5a2ca74c-fdbf-40c9-92f8-2a7c6990a92a None None] MFA Rules not processed for user `57f36ff6dbd24787baf10788bdf8a1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:56.042686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5a2ca74c-fdbf-40c9-92f8-2a7c6990a92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:56.227308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 831/1675] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:57.345908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b445a2-9f28-400a-956d-b3d25469c805 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:57.347278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b445a2-9f28-400a-956d-b3d25469c805 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:57.347997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b445a2-9f28-400a-956d-b3d25469c805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:57.393674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-31b445a2-9f28-400a-956d-b3d25469c805 None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:57.398747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-31b445a2-9f28-400a-956d-b3d25469c805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:57.420746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9290-357d-472f-9d19-21a99ec19330 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:57.421717 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9290-357d-472f-9d19-21a99ec19330 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:57.422192 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9290-357d-472f-9d19-21a99ec19330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:57.458474 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-197d9290-357d-472f-9d19-21a99ec19330 None None] MFA Rules not processed for user `dfc52b61bcf845d1953a5a111abb3666`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:57.462588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-197d9290-357d-472f-9d19-21a99ec19330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:57.495908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 832/1676] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:26:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:26:57.552940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 845/1677] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:26:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:26:57.964348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d9290-357d-472f-9d19-21a99ec19330 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:57.966147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-197d9290-357d-472f-9d19-21a99ec19330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:58.139033 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d9290-357d-472f-9d19-21a99ec19330 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:58.151915 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496f514-2f51-4153-8b2f-02935a479ae8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:58.152849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496f514-2f51-4153-8b2f-02935a479ae8 service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:58.153307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496f514-2f51-4153-8b2f-02935a479ae8 service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:58.153729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496f514-2f51-4153-8b2f-02935a479ae8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:58.164178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496f514-2f51-4153-8b2f-02935a479ae8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:58.165817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496f514-2f51-4153-8b2f-02935a479ae8 service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:58.193136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 833/1678] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:26:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:26:59.167624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b445a2-9f28-400a-956d-b3d25469c805 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:26:59.321755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b445a2-9f28-400a-956d-b3d25469c805 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:26:59.336773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05426611-c1e8-432b-9c7f-6202cc6d48f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:26:59.338123 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05426611-c1e8-432b-9c7f-6202cc6d48f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:59.348378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05426611-c1e8-432b-9c7f-6202cc6d48f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:59.348827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05426611-c1e8-432b-9c7f-6202cc6d48f3 admin admin] PATH_INFO: `/v3/users/84bac7bc750a40a9a68f9b027bc0d048` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:59.350945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05426611-c1e8-432b-9c7f-6202cc6d48f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84bac7bc750a40a9a68f9b027bc0d048)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:26:59.359259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05426611-c1e8-432b-9c7f-6202cc6d48f3 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:26:59.594430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ccf54-5a4c-440b-b995-6b457221fa82 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:59.594927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ccf54-5a4c-440b-b995-6b457221fa82 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:59.595413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ccf54-5a4c-440b-b995-6b457221fa82 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:59.597013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 834/1679] 10.222.0.64 () {54 vars in 912 bytes} [Fri May 13 17:26:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:26:59.613625 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26bb1f-adf5-4e2d-bf86-07ff76085083 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:26:59.615692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26bb1f-adf5-4e2d-bf86-07ff76085083 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:26:59.615692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26bb1f-adf5-4e2d-bf86-07ff76085083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:26:59.746022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-05426611-c1e8-432b-9c7f-6202cc6d48f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84bac7bc750a40a9a68f9b027bc0d048'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:59.747377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4a26bb1f-adf5-4e2d-bf86-07ff76085083 None None] MFA Rules not processed for user `d99855838f77462886cc87db440e1037`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:26:59.757905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4a26bb1f-adf5-4e2d-bf86-07ff76085083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:26:59.799599 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-05426611-c1e8-432b-9c7f-6202cc6d48f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84bac7bc750a40a9a68f9b027bc0d048'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:26:59.800727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-05426611-c1e8-432b-9c7f-6202cc6d48f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84bac7bc750a40a9a68f9b027bc0d048'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:00.016958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 835/1680] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:26:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:00.016958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26bb1f-adf5-4e2d-bf86-07ff76085083 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:00.016958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26bb1f-adf5-4e2d-bf86-07ff76085083 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:00.016958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cb749-f245-4708-b1c1-4df41b3ee775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:00.019848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cb749-f245-4708-b1c1-4df41b3ee775 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:00.019848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cb749-f245-4708-b1c1-4df41b3ee775 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:00.019848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cb749-f245-4708-b1c1-4df41b3ee775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:00.019848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cb749-f245-4708-b1c1-4df41b3ee775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:00.019848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cb749-f245-4708-b1c1-4df41b3ee775 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:00.019848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 836/1681] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:26:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:00.301622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cb749-f245-4708-b1c1-4df41b3ee775 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:00.303451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9c7cb749-f245-4708-b1c1-4df41b3ee775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:00.332102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cb749-f245-4708-b1c1-4df41b3ee775 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:00.373189 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:00.375222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:00.375524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:00.376127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] PATH_INFO: `/v3/users/5ceb047e6d0b46279f54e507fd53b7f9` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:00.378029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ceb047e6d0b46279f54e507fd53b7f9)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:00.380403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:00.433616 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-05426611-c1e8-432b-9c7f-6202cc6d48f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84bac7bc750a40a9a68f9b027bc0d048'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:00.443272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-05426611-c1e8-432b-9c7f-6202cc6d48f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84bac7bc750a40a9a68f9b027bc0d048'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:00.456377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 846/1682] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:26:59 2022] DELETE /identity/v3/users/84bac7bc750a40a9a68f9b027bc0d048 => generated 0 bytes in 1289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:00.745785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ceb047e6d0b46279f54e507fd53b7f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:00.797477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ceb047e6d0b46279f54e507fd53b7f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:00.851255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ceb047e6d0b46279f54e507fd53b7f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:00.851255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ceb047e6d0b46279f54e507fd53b7f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:00.970610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ceb047e6d0b46279f54e507fd53b7f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:00.983543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 837/1683] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:00 2022] DELETE /identity/v3/users/5ceb047e6d0b46279f54e507fd53b7f9 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:00.987625 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b10e2-8a43-49fb-b95c-0a80b5fd3d12 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:00.989961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b10e2-8a43-49fb-b95c-0a80b5fd3d12 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:00.990682 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b10e2-8a43-49fb-b95c-0a80b5fd3d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:01.036235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d32b10e2-8a43-49fb-b95c-0a80b5fd3d12 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:01.054052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d32b10e2-8a43-49fb-b95c-0a80b5fd3d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:01.207539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 847/1684] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:01.226219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:01.228130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:01.278913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328476c0-6316-4ea2-8df9-18cb6f40558b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:01.279229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328476c0-6316-4ea2-8df9-18cb6f40558b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:01.280510 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328476c0-6316-4ea2-8df9-18cb6f40558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:01.354727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-328476c0-6316-4ea2-8df9-18cb6f40558b None None] MFA Rules not processed for user `d99855838f77462886cc87db440e1037`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:01.362827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-328476c0-6316-4ea2-8df9-18cb6f40558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:01.478806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053fb4-fd96-47bd-b409-519977c596fa admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:01.503870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd303d-b910-4199-9227-0e15a81d1227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:01.508881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd303d-b910-4199-9227-0e15a81d1227 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:01.508881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd303d-b910-4199-9227-0e15a81d1227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:01.508881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd303d-b910-4199-9227-0e15a81d1227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:01.537656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd303d-b910-4199-9227-0e15a81d1227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:01.540213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 848/1685] 10.222.0.82 () {58 vars in 1015 bytes} [Fri May 13 17:27:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:01.543761 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd303d-b910-4199-9227-0e15a81d1227 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:01.547318 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce7c6-0f7c-4bf0-8a7e-b92ce1caa8ec None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:01.547829 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce7c6-0f7c-4bf0-8a7e-b92ce1caa8ec None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:01.549020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce7c6-0f7c-4bf0-8a7e-b92ce1caa8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:01.596422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-875ce7c6-0f7c-4bf0-8a7e-b92ce1caa8ec None None] MFA Rules not processed for user `efc23cbdbebc423baed1a2cb6c6cd7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:01.596422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-875ce7c6-0f7c-4bf0-8a7e-b92ce1caa8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:01.599884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 838/1686] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:01.601618 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd303d-b910-4199-9227-0e15a81d1227 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:01.633003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd303d-b910-4199-9227-0e15a81d1227 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:01.653889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37e6b2-32b2-46a7-977f-82bc9f31e7b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:01.653889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37e6b2-32b2-46a7-977f-82bc9f31e7b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:01.653889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37e6b2-32b2-46a7-977f-82bc9f31e7b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:01.653889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37e6b2-32b2-46a7-977f-82bc9f31e7b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:01.671949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37e6b2-32b2-46a7-977f-82bc9f31e7b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:01.676622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37e6b2-32b2-46a7-977f-82bc9f31e7b9 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:01.724039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 849/1687] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:01.727976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce7c6-0f7c-4bf0-8a7e-b92ce1caa8ec None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:01.727976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-875ce7c6-0f7c-4bf0-8a7e-b92ce1caa8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:01.730385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 839/1688] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:01.745624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce7c6-0f7c-4bf0-8a7e-b92ce1caa8ec None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:01.768744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:01.770174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:01.770665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:01.771148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] PATH_INFO: `/v3/projects/6e2af938bef24636b081da69f3f42432` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:01.773015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2af938bef24636b081da69f3f42432)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:01.774665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: WARNING py.warnings [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 17:27:01.774665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: warnings.warn(msg) May 13 17:27:01.774665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: May 13 17:27:01.776023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:02.024555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2af938bef24636b081da69f3f42432', 'request_id': 'req-7c490f7d-1c16-431f-9d7d-885a20059803'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:02.049345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2af938bef24636b081da69f3f42432', 'request_id': 'req-7c490f7d-1c16-431f-9d7d-885a20059803'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:02.194594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2af938bef24636b081da69f3f42432', 'request_id': 'req-7c490f7d-1c16-431f-9d7d-885a20059803'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:02.293547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] The token cache is being invalidate because project 6e2af938bef24636b081da69f3f42432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:02.294500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:02.297486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:02.299189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 850/1689] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:01 2022] DELETE /identity/v3/projects/6e2af938bef24636b081da69f3f42432 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:02.303281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37e6b2-32b2-46a7-977f-82bc9f31e7b9 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:02.323664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37e6b2-32b2-46a7-977f-82bc9f31e7b9 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:02.518848 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:02.520601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:02.599513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aabd0-e569-4f60-8645-19968880d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:02.600429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aabd0-e569-4f60-8645-19968880d89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:02.600712 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aabd0-e569-4f60-8645-19968880d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:02.600988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aabd0-e569-4f60-8645-19968880d89b admin admin] PATH_INFO: `/v3/users/5d58095aa7dd499c99be9f8f227abd75` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:02.603221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93aabd0-e569-4f60-8645-19968880d89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d58095aa7dd499c99be9f8f227abd75)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:02.605207 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93aabd0-e569-4f60-8645-19968880d89b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:02.712920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c490f7d-1c16-431f-9d7d-885a20059803 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:02.724031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:02.725047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:02.725342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:02.725667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] PATH_INFO: `/v3/users/4543ac206ae4420eb926127d14e2877b` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:02.727087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4543ac206ae4420eb926127d14e2877b)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:02.738032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:02.951375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c93aabd0-e569-4f60-8645-19968880d89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d58095aa7dd499c99be9f8f227abd75'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:02.969906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4543ac206ae4420eb926127d14e2877b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:02.993590 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c93aabd0-e569-4f60-8645-19968880d89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d58095aa7dd499c99be9f8f227abd75'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.009615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4543ac206ae4420eb926127d14e2877b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.012092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4543ac206ae4420eb926127d14e2877b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.017044 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c93aabd0-e569-4f60-8645-19968880d89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d58095aa7dd499c99be9f8f227abd75'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.020487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c93aabd0-e569-4f60-8645-19968880d89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d58095aa7dd499c99be9f8f227abd75'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.112541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4543ac206ae4420eb926127d14e2877b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.122636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4543ac206ae4420eb926127d14e2877b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.146900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 851/1690] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:02 2022] DELETE /identity/v3/users/4543ac206ae4420eb926127d14e2877b => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:03.150618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:03.164159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:03.232002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c93aabd0-e569-4f60-8645-19968880d89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d58095aa7dd499c99be9f8f227abd75'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.258457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 840/1691] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:02 2022] DELETE /identity/v3/users/5d58095aa7dd499c99be9f8f227abd75 => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:03.261904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aeb07-3639-4746-a9a2-f8e1667eb808 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:03.263728 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aeb07-3639-4746-a9a2-f8e1667eb808 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:03.265326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aeb07-3639-4746-a9a2-f8e1667eb808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:03.332319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-085aeb07-3639-4746-a9a2-f8e1667eb808 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:03.345070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-085aeb07-3639-4746-a9a2-f8e1667eb808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:03.375466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04999fa4-eb47-4e02-9d1b-244b302ab211 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:03.518221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 841/1692] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:03.537878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:03.538767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:03.539072 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:03.539427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] PATH_INFO: `/v3/projects/f2ad6b80d4e64431aea1f48de4aa5548` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:03.540657 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ad6b80d4e64431aea1f48de4aa5548)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:03.542580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:03.600004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085aeb07-3639-4746-a9a2-f8e1667eb808 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:03.602314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-085aeb07-3639-4746-a9a2-f8e1667eb808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:03.721088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ad6b80d4e64431aea1f48de4aa5548', 'request_id': 'req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.732738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ad6b80d4e64431aea1f48de4aa5548', 'request_id': 'req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.843298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085aeb07-3639-4746-a9a2-f8e1667eb808 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:03.854784 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ad6b80d4e64431aea1f48de4aa5548', 'request_id': 'req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.873795 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] The token cache is being invalidate because project f2ad6b80d4e64431aea1f48de4aa5548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:03.875026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.876584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c66ec489-b171-4b5c-9fe0-ea7adf05a00f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:03.915098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 852/1693] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:03 2022] DELETE /identity/v3/projects/f2ad6b80d4e64431aea1f48de4aa5548 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:03.920762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61efecf-bba1-4b44-8b70-8b863945a8b7 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:03.920762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61efecf-bba1-4b44-8b70-8b863945a8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:03.920762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61efecf-bba1-4b44-8b70-8b863945a8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:03.963119 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f61efecf-bba1-4b44-8b70-8b863945a8b7 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:03.966719 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f61efecf-bba1-4b44-8b70-8b863945a8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:04.000357 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917ffc8-7ba4-4fbc-a87b-8908bdbd3584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:04.001085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917ffc8-7ba4-4fbc-a87b-8908bdbd3584 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:04.001581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917ffc8-7ba4-4fbc-a87b-8908bdbd3584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:04.002069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917ffc8-7ba4-4fbc-a87b-8908bdbd3584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:04.007382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d917ffc8-7ba4-4fbc-a87b-8908bdbd3584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:04.117379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 853/1694] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:04.117379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61efecf-bba1-4b44-8b70-8b863945a8b7 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:04.119319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f61efecf-bba1-4b44-8b70-8b863945a8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:04.170249 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61efecf-bba1-4b44-8b70-8b863945a8b7 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:04.189642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:04.191185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:04.197541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:04.197541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] PATH_INFO: `/v3/projects/8531edacdd5b446dba9d77ab0af63d3b` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:04.197541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8531edacdd5b446dba9d77ab0af63d3b)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:04.197541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:04.203357 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917ffc8-7ba4-4fbc-a87b-8908bdbd3584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:04.204752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917ffc8-7ba4-4fbc-a87b-8908bdbd3584 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:04.220470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 842/1695] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:04.223631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3228-bec0-4cba-ae0c-9b62eab47e44 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:04.223928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3228-bec0-4cba-ae0c-9b62eab47e44 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:04.224210 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3228-bec0-4cba-ae0c-9b62eab47e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:04.253061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-91fd3228-bec0-4cba-ae0c-9b62eab47e44 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:04.254932 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-91fd3228-bec0-4cba-ae0c-9b62eab47e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:04.289313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 843/1696] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:04.291502 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd3228-bec0-4cba-ae0c-9b62eab47e44 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:04.324403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd3228-bec0-4cba-ae0c-9b62eab47e44 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:04.331586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ffb61-ea16-4cc6-8538-0e9eb760d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:04.332393 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ffb61-ea16-4cc6-8538-0e9eb760d8dc admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:04.332996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ffb61-ea16-4cc6-8538-0e9eb760d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:04.333068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ffb61-ea16-4cc6-8538-0e9eb760d8dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:04.335096 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ffb61-ea16-4cc6-8538-0e9eb760d8dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:04.336003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ffb61-ea16-4cc6-8538-0e9eb760d8dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:04.337951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ffb61-ea16-4cc6-8538-0e9eb760d8dc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:04.363368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 844/1697] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:27:04.364451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ffb61-ea16-4cc6-8538-0e9eb760d8dc admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:04.399914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ffb61-ea16-4cc6-8538-0e9eb760d8dc admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:04.409102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8531edacdd5b446dba9d77ab0af63d3b', 'request_id': 'req-e19671b5-0c7c-4d0c-9a4e-adf454779f20'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:04.417527 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8531edacdd5b446dba9d77ab0af63d3b', 'request_id': 'req-e19671b5-0c7c-4d0c-9a4e-adf454779f20'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:04.511641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731d31e-b6ec-47a9-b082-ebfb0a6e85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:04.511641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731d31e-b6ec-47a9-b082-ebfb0a6e85c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:04.511641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731d31e-b6ec-47a9-b082-ebfb0a6e85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:04.511641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731d31e-b6ec-47a9-b082-ebfb0a6e85c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:04.512076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731d31e-b6ec-47a9-b082-ebfb0a6e85c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:04.512076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731d31e-b6ec-47a9-b082-ebfb0a6e85c6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:04.530079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8531edacdd5b446dba9d77ab0af63d3b', 'request_id': 'req-e19671b5-0c7c-4d0c-9a4e-adf454779f20'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:04.554386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] The token cache is being invalidate because project 8531edacdd5b446dba9d77ab0af63d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:04.555320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:04.556299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-e19671b5-0c7c-4d0c-9a4e-adf454779f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:04.559874 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 854/1698] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:04 2022] DELETE /identity/v3/projects/8531edacdd5b446dba9d77ab0af63d3b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:04.564454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03f7c5-4feb-4a5c-809d-b23f58bcf38b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:04.565005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03f7c5-4feb-4a5c-809d-b23f58bcf38b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:04.565709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03f7c5-4feb-4a5c-809d-b23f58bcf38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:04.593503 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-fd03f7c5-4feb-4a5c-809d-b23f58bcf38b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:04.593503 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fd03f7c5-4feb-4a5c-809d-b23f58bcf38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:04.609799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 855/1699] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:04.620955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c55f8-fc4a-462f-99fb-6341445fd78b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:04.620955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c55f8-fc4a-462f-99fb-6341445fd78b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:04.620955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c55f8-fc4a-462f-99fb-6341445fd78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:04.649449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-811c55f8-fc4a-462f-99fb-6341445fd78b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:04.650773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-811c55f8-fc4a-462f-99fb-6341445fd78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:04.671854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 856/1700] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:04.673850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c55f8-fc4a-462f-99fb-6341445fd78b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:04.700561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c55f8-fc4a-462f-99fb-6341445fd78b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:04.708977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c6aa-42c1-45d8-a5fc-48386eb35be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:04.709308 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c6aa-42c1-45d8-a5fc-48386eb35be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:04.709603 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c6aa-42c1-45d8-a5fc-48386eb35be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:04.709884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c6aa-42c1-45d8-a5fc-48386eb35be7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:04.710628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2c6aa-42c1-45d8-a5fc-48386eb35be7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:04.710956 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2c6aa-42c1-45d8-a5fc-48386eb35be7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:04.712668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2c6aa-42c1-45d8-a5fc-48386eb35be7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:04.713388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 845/1701] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:04 2022] POST /identity/v3/projects => generated 363 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:04.719499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731d31e-b6ec-47a9-b082-ebfb0a6e85c6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:04.721244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2731d31e-b6ec-47a9-b082-ebfb0a6e85c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:04.768390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 857/1702] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:27:04.786908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c6aa-42c1-45d8-a5fc-48386eb35be7 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:04.819753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c6aa-42c1-45d8-a5fc-48386eb35be7 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:04.880383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731d31e-b6ec-47a9-b082-ebfb0a6e85c6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:04.890661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3e8be-961f-4868-8e6a-5ae442f66a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:04.890661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3e8be-961f-4868-8e6a-5ae442f66a80 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:04.890661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3e8be-961f-4868-8e6a-5ae442f66a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:04.890661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3e8be-961f-4868-8e6a-5ae442f66a80 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:04.891262 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3e8be-961f-4868-8e6a-5ae442f66a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:04.891985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3e8be-961f-4868-8e6a-5ae442f66a80 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:05.002251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 846/1703] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:04 2022] POST /identity/v3/users => generated 282 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:05.003227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3e8be-961f-4868-8e6a-5ae442f66a80 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:05.011219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75446846-af10-497f-a27f-6fac3edeae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:05.011219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75446846-af10-497f-a27f-6fac3edeae71 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:05.011633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75446846-af10-497f-a27f-6fac3edeae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:05.011717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75446846-af10-497f-a27f-6fac3edeae71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:05.012406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75446846-af10-497f-a27f-6fac3edeae71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:05.015923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75446846-af10-497f-a27f-6fac3edeae71 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:05.023178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3e8be-961f-4868-8e6a-5ae442f66a80 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:05.036025 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71ee1-16fe-4153-841d-3cff5f449a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:05.036880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71ee1-16fe-4153-841d-3cff5f449a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:05.037661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71ee1-16fe-4153-841d-3cff5f449a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:05.037950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71ee1-16fe-4153-841d-3cff5f449a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:05.038816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a71ee1-16fe-4153-841d-3cff5f449a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:05.042763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a71ee1-16fe-4153-841d-3cff5f449a28 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:05.079820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 847/1704] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:05.092284 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71ee1-16fe-4153-841d-3cff5f449a28 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:05.104454 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71ee1-16fe-4153-841d-3cff5f449a28 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:05.109961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c35bc1-e229-4601-a4eb-30682310a736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:05.114954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c35bc1-e229-4601-a4eb-30682310a736 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:05.114954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c35bc1-e229-4601-a4eb-30682310a736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:05.114954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c35bc1-e229-4601-a4eb-30682310a736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:05.114954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c35bc1-e229-4601-a4eb-30682310a736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:05.115709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c35bc1-e229-4601-a4eb-30682310a736 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:05.133729 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 858/1705] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:04 2022] POST /identity/v3/projects => generated 373 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:05.135659 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45924317-9bec-4278-9113-401357f44bd4 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:05.135974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45924317-9bec-4278-9113-401357f44bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:05.136291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45924317-9bec-4278-9113-401357f44bd4 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:05.137831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 859/1706] 10.222.0.64 () {54 vars in 921 bytes} [Fri May 13 17:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:27:05.138686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45924317-9bec-4278-9113-401357f44bd4 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:05.153637 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 848/1707] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:05.160589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c35bc1-e229-4601-a4eb-30682310a736 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:05.184674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c35bc1-e229-4601-a4eb-30682310a736 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:05.310520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c564d5-0fc0-4a72-b895-10b18fcc0140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:05.310520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c564d5-0fc0-4a72-b895-10b18fcc0140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:05.310520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c564d5-0fc0-4a72-b895-10b18fcc0140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:05.310520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c564d5-0fc0-4a72-b895-10b18fcc0140 admin admin] PATH_INFO: `/v3/projects/30ec5d329c344a86804b8758e0fac618/users/72f92a0901f74a00ae70677ad737afa9/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:05.317420 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45924317-9bec-4278-9113-401357f44bd4 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:05.326711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f157c6-9bbd-4ef0-8d5b-334030b48b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:05.336601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f157c6-9bbd-4ef0-8d5b-334030b48b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:05.336601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f157c6-9bbd-4ef0-8d5b-334030b48b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:05.336601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f157c6-9bbd-4ef0-8d5b-334030b48b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:05.336601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f157c6-9bbd-4ef0-8d5b-334030b48b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:05.349080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f157c6-9bbd-4ef0-8d5b-334030b48b7d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:05.354743 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c564d5-0fc0-4a72-b895-10b18fcc0140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ec5d329c344a86804b8758e0fac618, user_id=72f92a0901f74a00ae70677ad737afa9, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:05.359397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c564d5-0fc0-4a72-b895-10b18fcc0140 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:05.459566 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 860/1709] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:05 2022] POST /identity/v3/users => generated 287 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:05.461514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b2aa-80e5-491f-9fd1-b4d933bb32aa None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:05.462143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b2aa-80e5-491f-9fd1-b4d933bb32aa None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:05.462679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b2aa-80e5-491f-9fd1-b4d933bb32aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:05.466375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 849/1709] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:05 2022] PUT /identity/v3/projects/30ec5d329c344a86804b8758e0fac618/users/72f92a0901f74a00ae70677ad737afa9/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:05.467388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c564d5-0fc0-4a72-b895-10b18fcc0140 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:05.497810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-34c3b2aa-80e5-491f-9fd1-b4d933bb32aa None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:05.503700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-34c3b2aa-80e5-491f-9fd1-b4d933bb32aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:05.568325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c564d5-0fc0-4a72-b895-10b18fcc0140 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:05.591307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15df422-3013-415b-9cfa-8b6e64d148bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:05.593494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15df422-3013-415b-9cfa-8b6e64d148bb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:05.593876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15df422-3013-415b-9cfa-8b6e64d148bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:05.594556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15df422-3013-415b-9cfa-8b6e64d148bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:05.595572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15df422-3013-415b-9cfa-8b6e64d148bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:05.597548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15df422-3013-415b-9cfa-8b6e64d148bb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:05.632013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 850/1710] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:05.639025 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458030f-1eab-4525-ae16-e95729c2895f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:05.639451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458030f-1eab-4525-ae16-e95729c2895f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:05.639997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458030f-1eab-4525-ae16-e95729c2895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:05.694407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 861/1711] 10.222.0.64 () {58 vars in 1018 bytes} [Fri May 13 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:05.697053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3b2aa-80e5-491f-9fd1-b4d933bb32aa None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:05.709639 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4458030f-1eab-4525-ae16-e95729c2895f None None] MFA Rules not processed for user `72f92a0901f74a00ae70677ad737afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:05.711779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4458030f-1eab-4525-ae16-e95729c2895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:05.716568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3b2aa-80e5-491f-9fd1-b4d933bb32aa None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:05.724333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a007429-59c3-4058-9441-439dbd8eb906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:05.725508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a007429-59c3-4058-9441-439dbd8eb906 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:05.725651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a007429-59c3-4058-9441-439dbd8eb906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:05.725899 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a007429-59c3-4058-9441-439dbd8eb906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:05.726843 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a007429-59c3-4058-9441-439dbd8eb906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:05.728613 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a007429-59c3-4058-9441-439dbd8eb906 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:05.743883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 862/1712] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:05.744760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a007429-59c3-4058-9441-439dbd8eb906 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:05.746646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7a007429-59c3-4058-9441-439dbd8eb906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:05.760886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a007429-59c3-4058-9441-439dbd8eb906 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:05.769990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:05.771121 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:05.771436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:05.771716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] PATH_INFO: `/v3/projects/cae8d0353d3c471e98971c6cff149bf5` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:05.773050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae8d0353d3c471e98971c6cff149bf5)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:05.776481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:05.891754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 851/1713] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:05.891754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458030f-1eab-4525-ae16-e95729c2895f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:05.897754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4458030f-1eab-4525-ae16-e95729c2895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:05.950874 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458030f-1eab-4525-ae16-e95729c2895f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:05.988522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae8d0353d3c471e98971c6cff149bf5', 'request_id': 'req-ca337d64-de43-4f3c-85ce-ec96c1eedd16'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:06.012463 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae8d0353d3c471e98971c6cff149bf5', 'request_id': 'req-ca337d64-de43-4f3c-85ce-ec96c1eedd16'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:06.065619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92a8ed-3a6a-48c1-af75-60ee55c3cd78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:06.066361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92a8ed-3a6a-48c1-af75-60ee55c3cd78 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:06.068514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92a8ed-3a6a-48c1-af75-60ee55c3cd78 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:06.068514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92a8ed-3a6a-48c1-af75-60ee55c3cd78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:06.080660 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92a8ed-3a6a-48c1-af75-60ee55c3cd78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:06.082808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92a8ed-3a6a-48c1-af75-60ee55c3cd78 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:06.111348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae8d0353d3c471e98971c6cff149bf5', 'request_id': 'req-ca337d64-de43-4f3c-85ce-ec96c1eedd16'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:06.114962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 852/1714] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:06.117825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92a8ed-3a6a-48c1-af75-60ee55c3cd78 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:06.140358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] The token cache is being invalidate because project cae8d0353d3c471e98971c6cff149bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:06.141799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:06.143543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:06.157180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 863/1715] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:05 2022] DELETE /identity/v3/projects/cae8d0353d3c471e98971c6cff149bf5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:06.159814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:06.164079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:06.275895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92a8ed-3a6a-48c1-af75-60ee55c3cd78 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:06.289997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bf18b-b338-4b4c-9019-c855b161fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:06.291113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf18b-b338-4b4c-9019-c855b161fe86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:06.291558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf18b-b338-4b4c-9019-c855b161fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:06.291980 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf18b-b338-4b4c-9019-c855b161fe86 admin admin] PATH_INFO: `/v3/projects/3663d950aeb5452b8ce8566ebfe2bbff/users/5cac7f6204134f788a8885b374b5d77e/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:06.360261 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bf18b-b338-4b4c-9019-c855b161fe86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3663d950aeb5452b8ce8566ebfe2bbff, user_id=5cac7f6204134f788a8885b374b5d77e, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:06.364149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bf18b-b338-4b4c-9019-c855b161fe86 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:06.370380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca337d64-de43-4f3c-85ce-ec96c1eedd16 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:06.383172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490347a7-53a4-480c-b764-9611173f4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:06.383976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490347a7-53a4-480c-b764-9611173f4491 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:06.388530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490347a7-53a4-480c-b764-9611173f4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:06.388530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490347a7-53a4-480c-b764-9611173f4491 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:06.388530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490347a7-53a4-480c-b764-9611173f4491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:06.396237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490347a7-53a4-480c-b764-9611173f4491 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:06.469112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 853/1716] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:06 2022] PUT /identity/v3/projects/3663d950aeb5452b8ce8566ebfe2bbff/users/5cac7f6204134f788a8885b374b5d77e/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:06.478505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bf18b-b338-4b4c-9019-c855b161fe86 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:06.478505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-753bf18b-b338-4b4c-9019-c855b161fe86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:06.552735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 864/1717] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:06 2022] POST /identity/v3/projects => generated 363 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:06.552735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de897476-5ccc-472b-9733-a49fda16c34a None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:06.552735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de897476-5ccc-472b-9733-a49fda16c34a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:06.552735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de897476-5ccc-472b-9733-a49fda16c34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:06.646727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bf18b-b338-4b4c-9019-c855b161fe86 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:06.669925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-de897476-5ccc-472b-9733-a49fda16c34a None None] MFA Rules not processed for user `5cac7f6204134f788a8885b374b5d77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:06.672494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-de897476-5ccc-472b-9733-a49fda16c34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:06.771598 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:06.772718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:06.772930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:06.773249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] PATH_INFO: `/v3/users/dec25bf36f124ab48eca7522b168c5f9` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:06.774714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec25bf36f124ab48eca7522b168c5f9)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:06.777256 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:06.787155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 865/1718] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:06.791650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de897476-5ccc-472b-9733-a49fda16c34a None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:06.816006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de897476-5ccc-472b-9733-a49fda16c34a None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:06.826485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec75e69-5979-4c71-b955-9bf852694944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:06.827832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec75e69-5979-4c71-b955-9bf852694944 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:06.828147 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec75e69-5979-4c71-b955-9bf852694944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:06.829746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec75e69-5979-4c71-b955-9bf852694944 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:06.830865 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec75e69-5979-4c71-b955-9bf852694944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:06.833905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec75e69-5979-4c71-b955-9bf852694944 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:06.928950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 866/1719] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:06 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:06.929948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec75e69-5979-4c71-b955-9bf852694944 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:06.932681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-bec75e69-5979-4c71-b955-9bf852694944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:06.952491 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec75e69-5979-4c71-b955-9bf852694944 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:06.973430 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e507d9-d0a1-4caa-b3e5-4fa5fa52b496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:06.974140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e507d9-d0a1-4caa-b3e5-4fa5fa52b496 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:06.974429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e507d9-d0a1-4caa-b3e5-4fa5fa52b496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:06.974707 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e507d9-d0a1-4caa-b3e5-4fa5fa52b496 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:06.975453 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e507d9-d0a1-4caa-b3e5-4fa5fa52b496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:06.977414 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e507d9-d0a1-4caa-b3e5-4fa5fa52b496 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:07.054798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec25bf36f124ab48eca7522b168c5f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:07.070163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec25bf36f124ab48eca7522b168c5f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:07.094243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec25bf36f124ab48eca7522b168c5f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:07.094243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec25bf36f124ab48eca7522b168c5f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:07.124998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 867/1720] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:06 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:07.124998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e507d9-d0a1-4caa-b3e5-4fa5fa52b496 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:07.209594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec25bf36f124ab48eca7522b168c5f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:07.221213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 854/1721] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:06 2022] DELETE /identity/v3/users/dec25bf36f124ab48eca7522b168c5f9 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:07.221213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:07.224238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:07.256294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e507d9-d0a1-4caa-b3e5-4fa5fa52b496 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:07.389171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a93033-a838-4112-90de-9777f6164941 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:07.401438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b8cad-e293-466f-8be6-a61f6a38a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:07.402176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8cad-e293-466f-8be6-a61f6a38a660 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:07.402462 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8cad-e293-466f-8be6-a61f6a38a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:07.403034 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8cad-e293-466f-8be6-a61f6a38a660 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:07.403746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b8cad-e293-466f-8be6-a61f6a38a660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:07.405809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b8cad-e293-466f-8be6-a61f6a38a660 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:07.456139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c52f8d-f24d-4e39-a493-54708a9fcc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:07.456761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c52f8d-f24d-4e39-a493-54708a9fcc91 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:07.463201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c52f8d-f24d-4e39-a493-54708a9fcc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:07.463684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c52f8d-f24d-4e39-a493-54708a9fcc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:07.465355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c52f8d-f24d-4e39-a493-54708a9fcc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:07.467371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c52f8d-f24d-4e39-a493-54708a9fcc91 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:07.482889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 868/1722] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:07.487732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c52f8d-f24d-4e39-a493-54708a9fcc91 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:07.495357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-83c52f8d-f24d-4e39-a493-54708a9fcc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:07.510517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c52f8d-f24d-4e39-a493-54708a9fcc91 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:07.522723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319a335-32a9-4c09-b173-1210363aa8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:07.531170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a335-32a9-4c09-b173-1210363aa8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:07.531725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a335-32a9-4c09-b173-1210363aa8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:07.532706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319a335-32a9-4c09-b173-1210363aa8d2 admin admin] PATH_INFO: `/v3/projects/381c041f1a7e4b4ab726b69646180b28/users/fb9eceef2dfa4e2d9596f0c907401ada/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:07.547993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 855/1723] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:07 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:07.556608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b8cad-e293-466f-8be6-a61f6a38a660 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:07.561672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319a335-32a9-4c09-b173-1210363aa8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381c041f1a7e4b4ab726b69646180b28, user_id=fb9eceef2dfa4e2d9596f0c907401ada, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:07.564771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319a335-32a9-4c09-b173-1210363aa8d2 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:07.567493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b8cad-e293-466f-8be6-a61f6a38a660 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:07.573968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac17888-ec14-4ef2-8153-97a4b34045e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:07.574721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17888-ec14-4ef2-8153-97a4b34045e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:07.575254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17888-ec14-4ef2-8153-97a4b34045e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:07.575612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac17888-ec14-4ef2-8153-97a4b34045e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:07.576595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac17888-ec14-4ef2-8153-97a4b34045e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:07.578437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac17888-ec14-4ef2-8153-97a4b34045e3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:07.590974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 856/1724] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:07.595585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac17888-ec14-4ef2-8153-97a4b34045e3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:07.607597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac17888-ec14-4ef2-8153-97a4b34045e3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:07.613936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21364ec3-c00a-4449-b132-b9fee88a3ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:07.614918 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21364ec3-c00a-4449-b132-b9fee88a3ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:07.615325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21364ec3-c00a-4449-b132-b9fee88a3ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:07.615672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21364ec3-c00a-4449-b132-b9fee88a3ed7 admin admin] PATH_INFO: `/v3/projects/2d56b009af414e1fa645994f418cd06a/users/4278d4f88a1341db9ce17280e983b3e7/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:07.636587 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21364ec3-c00a-4449-b132-b9fee88a3ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d56b009af414e1fa645994f418cd06a, user_id=4278d4f88a1341db9ce17280e983b3e7, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:07.640631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21364ec3-c00a-4449-b132-b9fee88a3ed7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:07.652678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 869/1725] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:07 2022] PUT /identity/v3/projects/381c041f1a7e4b4ab726b69646180b28/users/fb9eceef2dfa4e2d9596f0c907401ada/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:07.658983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319a335-32a9-4c09-b173-1210363aa8d2 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:07.763919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 857/1726] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:07 2022] PUT /identity/v3/projects/2d56b009af414e1fa645994f418cd06a/users/4278d4f88a1341db9ce17280e983b3e7/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:07.763919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21364ec3-c00a-4449-b132-b9fee88a3ed7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:07.766238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-21364ec3-c00a-4449-b132-b9fee88a3ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:07.873475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21364ec3-c00a-4449-b132-b9fee88a3ed7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:07.881161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:07.882140 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:07.882556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:07.882935 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] PATH_INFO: `/v3/users/b8bc4bb32ef24674970b3b2b3044b50d` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:07.884605 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8bc4bb32ef24674970b3b2b3044b50d)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:07.887450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:07.998248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319a335-32a9-4c09-b173-1210363aa8d2 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:08.003042 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85b994-9414-4053-8c06-e71b20848606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:08.015557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85b994-9414-4053-8c06-e71b20848606 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:08.015891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85b994-9414-4053-8c06-e71b20848606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:08.031355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85b994-9414-4053-8c06-e71b20848606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:08.032295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85b994-9414-4053-8c06-e71b20848606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:08.042511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85b994-9414-4053-8c06-e71b20848606 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:08.092465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 870/1727] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:08.103150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8bc4bb32ef24674970b3b2b3044b50d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:08.105873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85b994-9414-4053-8c06-e71b20848606 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:08.126083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8bc4bb32ef24674970b3b2b3044b50d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:08.137356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85b994-9414-4053-8c06-e71b20848606 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:08.138135 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8bc4bb32ef24674970b3b2b3044b50d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:08.140829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8bc4bb32ef24674970b3b2b3044b50d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:08.156093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f18d67-47e6-4152-9e42-607f849d37db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:08.156878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18d67-47e6-4152-9e42-607f849d37db admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:08.157171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18d67-47e6-4152-9e42-607f849d37db admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:08.157489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18d67-47e6-4152-9e42-607f849d37db admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:08.158423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f18d67-47e6-4152-9e42-607f849d37db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:08.160288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f18d67-47e6-4152-9e42-607f849d37db admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:08.189120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 871/1728] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:08.193425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f18d67-47e6-4152-9e42-607f849d37db admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:08.204982 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f18d67-47e6-4152-9e42-607f849d37db admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:08.241823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8bc4bb32ef24674970b3b2b3044b50d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:08.249757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80971024-d60f-4e81-8ca3-0d7900f70d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:08.251597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971024-d60f-4e81-8ca3-0d7900f70d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:08.251896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971024-d60f-4e81-8ca3-0d7900f70d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:08.252179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971024-d60f-4e81-8ca3-0d7900f70d53 admin admin] PATH_INFO: `/v3/projects/381c041f1a7e4b4ab726b69646180b28/users/fb9eceef2dfa4e2d9596f0c907401ada/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:08.258251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 858/1729] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:07 2022] DELETE /identity/v3/users/b8bc4bb32ef24674970b3b2b3044b50d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:08.258422 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:08.260025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80971024-d60f-4e81-8ca3-0d7900f70d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381c041f1a7e4b4ab726b69646180b28, user_id=fb9eceef2dfa4e2d9596f0c907401ada, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:08.262754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:08.266536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80971024-d60f-4e81-8ca3-0d7900f70d53 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:08.286033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 872/1730] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:08 2022] PUT /identity/v3/projects/381c041f1a7e4b4ab726b69646180b28/users/fb9eceef2dfa4e2d9596f0c907401ada/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:08.287611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46323055-6f3e-49bd-9fc7-013f715b2501 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:08.291612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46323055-6f3e-49bd-9fc7-013f715b2501 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:08.291612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46323055-6f3e-49bd-9fc7-013f715b2501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:08.310938 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-46323055-6f3e-49bd-9fc7-013f715b2501 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:08.313021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-46323055-6f3e-49bd-9fc7-013f715b2501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:08.417088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067900-7551-4f69-b9f3-744fd27c35ef admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:08.486731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d52345-8d41-4db3-8d7e-b0261e0e37c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:08.487499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d52345-8d41-4db3-8d7e-b0261e0e37c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:08.487792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d52345-8d41-4db3-8d7e-b0261e0e37c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:08.488072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d52345-8d41-4db3-8d7e-b0261e0e37c7 admin admin] PATH_INFO: `/v3/projects/2d56b009af414e1fa645994f418cd06a/users/4278d4f88a1341db9ce17280e983b3e7/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:08.490203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d52345-8d41-4db3-8d7e-b0261e0e37c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d56b009af414e1fa645994f418cd06a, user_id=4278d4f88a1341db9ce17280e983b3e7, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:08.492970 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d52345-8d41-4db3-8d7e-b0261e0e37c7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:08.506948 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 859/1731] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:08 2022] PUT /identity/v3/projects/2d56b009af414e1fa645994f418cd06a/users/4278d4f88a1341db9ce17280e983b3e7/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:08.519547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59661-f661-4ec8-ad8b-e694b539e325 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:08.519844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59661-f661-4ec8-ad8b-e694b539e325 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:08.520208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59661-f661-4ec8-ad8b-e694b539e325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:08.526263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 873/1732] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:08.527920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb322-a85f-4860-bb68-10d1a2e9b54f None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:08.528272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb322-a85f-4860-bb68-10d1a2e9b54f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:08.532430 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb322-a85f-4860-bb68-10d1a2e9b54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:08.556507 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b3e59661-f661-4ec8-ad8b-e694b539e325 None None] MFA Rules not processed for user `fb9eceef2dfa4e2d9596f0c907401ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:08.557893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b3e59661-f661-4ec8-ad8b-e694b539e325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:08.622742 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-4aceb322-a85f-4860-bb68-10d1a2e9b54f None None] MFA Rules not processed for user `4278d4f88a1341db9ce17280e983b3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:08.625298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-4aceb322-a85f-4860-bb68-10d1a2e9b54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:08.716782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 860/1733] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:08.719551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e59661-f661-4ec8-ad8b-e694b539e325 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:08.720104 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b3e59661-f661-4ec8-ad8b-e694b539e325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:08.796889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 874/1734] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:08.799687 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb322-a85f-4860-bb68-10d1a2e9b54f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:08.809791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-4aceb322-a85f-4860-bb68-10d1a2e9b54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:08.842901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e59661-f661-4ec8-ad8b-e694b539e325 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:08.862577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd3aee-6a88-467d-882b-4f916fcb9cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:08.863790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd3aee-6a88-467d-882b-4f916fcb9cba service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:08.864974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd3aee-6a88-467d-882b-4f916fcb9cba service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:08.866716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd3aee-6a88-467d-882b-4f916fcb9cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:08.958709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd3aee-6a88-467d-882b-4f916fcb9cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:08.961107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd3aee-6a88-467d-882b-4f916fcb9cba service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:08.980317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 861/1735] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:08.981201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd3aee-6a88-467d-882b-4f916fcb9cba service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:08.981400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb322-a85f-4860-bb68-10d1a2e9b54f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:08.982735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c1fd3aee-6a88-467d-882b-4f916fcb9cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:08.993071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:09.000260 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:09.009381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:09.009381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] PATH_INFO: `/v3/projects/ac37247315d14e31a08a3b77ebc90661` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:09.009381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac37247315d14e31a08a3b77ebc90661)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:09.016847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:09.053963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd3aee-6a88-467d-882b-4f916fcb9cba service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:09.058059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd7d62-9558-44ec-b658-4545f8bb9f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:09.060756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd7d62-9558-44ec-b658-4545f8bb9f2c service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:09.060756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd7d62-9558-44ec-b658-4545f8bb9f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:09.060756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd7d62-9558-44ec-b658-4545f8bb9f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:09.069699 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd7d62-9558-44ec-b658-4545f8bb9f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:09.071180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd7d62-9558-44ec-b658-4545f8bb9f2c service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:09.082686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 862/1736] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:09.083789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd7d62-9558-44ec-b658-4545f8bb9f2c service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:09.085144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-03fd7d62-9558-44ec-b658-4545f8bb9f2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:09.101729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd7d62-9558-44ec-b658-4545f8bb9f2c service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:09.106613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081addd6-5e27-4721-841a-718772cf1f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:09.107319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081addd6-5e27-4721-841a-718772cf1f76 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:09.107638 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081addd6-5e27-4721-841a-718772cf1f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:09.107890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081addd6-5e27-4721-841a-718772cf1f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:09.118316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081addd6-5e27-4721-841a-718772cf1f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:09.120022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081addd6-5e27-4721-841a-718772cf1f76 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:09.143581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 863/1737] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:09.214002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac37247315d14e31a08a3b77ebc90661', 'request_id': 'req-75661fdc-d450-44a9-b901-b01580b4d91d'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:09.226079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac37247315d14e31a08a3b77ebc90661', 'request_id': 'req-75661fdc-d450-44a9-b901-b01580b4d91d'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:09.306107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac37247315d14e31a08a3b77ebc90661', 'request_id': 'req-75661fdc-d450-44a9-b901-b01580b4d91d'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:09.337962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] The token cache is being invalidate because project ac37247315d14e31a08a3b77ebc90661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:09.338276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:09.348347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-75661fdc-d450-44a9-b901-b01580b4d91d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:09.354978 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 875/1738] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:08 2022] DELETE /identity/v3/projects/ac37247315d14e31a08a3b77ebc90661 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:09.360819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e32a-6cdb-4e6f-8b34-d1cea4859773 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:09.362795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e32a-6cdb-4e6f-8b34-d1cea4859773 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:09.363323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e32a-6cdb-4e6f-8b34-d1cea4859773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:09.392619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8788e32a-6cdb-4e6f-8b34-d1cea4859773 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:09.394058 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8788e32a-6cdb-4e6f-8b34-d1cea4859773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:09.525379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 864/1739] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:09.526898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f792d-758e-4a5a-b37d-6f43d83eedc3 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:09.527222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f792d-758e-4a5a-b37d-6f43d83eedc3 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:09.527590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f792d-758e-4a5a-b37d-6f43d83eedc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:09.549136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c61f792d-758e-4a5a-b37d-6f43d83eedc3 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:09.550473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c61f792d-758e-4a5a-b37d-6f43d83eedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:09.562164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 876/1740] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:09.566660 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788e32a-6cdb-4e6f-8b34-d1cea4859773 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:09.580180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788e32a-6cdb-4e6f-8b34-d1cea4859773 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:09.587569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaf2f6-e966-4b69-b46f-c0973d90b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:09.588508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf2f6-e966-4b69-b46f-c0973d90b8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:09.588864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf2f6-e966-4b69-b46f-c0973d90b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:09.589148 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf2f6-e966-4b69-b46f-c0973d90b8e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:09.590174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaf2f6-e966-4b69-b46f-c0973d90b8e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:09.590534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaf2f6-e966-4b69-b46f-c0973d90b8e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:09.593488 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaf2f6-e966-4b69-b46f-c0973d90b8e3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:09.609952 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 865/1741] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:27:09.614356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f792d-758e-4a5a-b37d-6f43d83eedc3 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:09.629851 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f792d-758e-4a5a-b37d-6f43d83eedc3 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:09.638908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41c836-4df5-4e6d-bde9-12a08c1e7277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:09.640958 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41c836-4df5-4e6d-bde9-12a08c1e7277 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:09.641937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41c836-4df5-4e6d-bde9-12a08c1e7277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:09.642457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41c836-4df5-4e6d-bde9-12a08c1e7277 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:09.643240 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41c836-4df5-4e6d-bde9-12a08c1e7277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:09.645373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41c836-4df5-4e6d-bde9-12a08c1e7277 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:09.749908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 877/1742] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:09 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:09.753845 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaf2f6-e966-4b69-b46f-c0973d90b8e3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:09.765793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaf2f6-e966-4b69-b46f-c0973d90b8e3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:09.897862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73493135-27bf-4155-87a0-c988ab5bdab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:09.898635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493135-27bf-4155-87a0-c988ab5bdab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:09.898917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493135-27bf-4155-87a0-c988ab5bdab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:09.899217 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493135-27bf-4155-87a0-c988ab5bdab0 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:09.899925 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73493135-27bf-4155-87a0-c988ab5bdab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:09.907943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73493135-27bf-4155-87a0-c988ab5bdab0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:10.009563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 866/1743] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:09 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:10.010997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41c836-4df5-4e6d-bde9-12a08c1e7277 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:10.033120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41c836-4df5-4e6d-bde9-12a08c1e7277 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:10.044200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c83f79-0143-423a-b94e-a9142306f9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:10.045000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c83f79-0143-423a-b94e-a9142306f9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:10.045332 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c83f79-0143-423a-b94e-a9142306f9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:10.045656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c83f79-0143-423a-b94e-a9142306f9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:10.047005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c83f79-0143-423a-b94e-a9142306f9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:10.048779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c83f79-0143-423a-b94e-a9142306f9f7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:10.070234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 878/1744] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:10.074334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73493135-27bf-4155-87a0-c988ab5bdab0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:10.096848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73493135-27bf-4155-87a0-c988ab5bdab0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:10.114970 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ede9f1-3678-4de2-9df7-4f6494e976e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:10.115810 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede9f1-3678-4de2-9df7-4f6494e976e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:10.116155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede9f1-3678-4de2-9df7-4f6494e976e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:10.125380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede9f1-3678-4de2-9df7-4f6494e976e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:10.125380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ede9f1-3678-4de2-9df7-4f6494e976e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:10.125380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ede9f1-3678-4de2-9df7-4f6494e976e4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:10.140732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 867/1745] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:10.144172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c83f79-0143-423a-b94e-a9142306f9f7 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:10.161198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c83f79-0143-423a-b94e-a9142306f9f7 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:10.178555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116a46c-766e-4713-ab4f-6d3d3610ec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:10.181811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116a46c-766e-4713-ab4f-6d3d3610ec94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:10.181811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116a46c-766e-4713-ab4f-6d3d3610ec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:10.181811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116a46c-766e-4713-ab4f-6d3d3610ec94 admin admin] PATH_INFO: `/v3/projects/71bfccc4d0054dc28c0acaf90247fc9d/users/0491be30c88b4ac98b498172ac8e3d1f/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:10.197539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116a46c-766e-4713-ab4f-6d3d3610ec94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bfccc4d0054dc28c0acaf90247fc9d, user_id=0491be30c88b4ac98b498172ac8e3d1f, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:10.203287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116a46c-766e-4713-ab4f-6d3d3610ec94 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:10.283568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 879/1746] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:10 2022] PUT /identity/v3/projects/71bfccc4d0054dc28c0acaf90247fc9d/users/0491be30c88b4ac98b498172ac8e3d1f/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:10.292345 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326adb-52a7-4585-aa96-3b9bbe4986bc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:10.292700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326adb-52a7-4585-aa96-3b9bbe4986bc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:10.293109 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326adb-52a7-4585-aa96-3b9bbe4986bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:10.372263 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c3326adb-52a7-4585-aa96-3b9bbe4986bc None None] MFA Rules not processed for user `0491be30c88b4ac98b498172ac8e3d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:10.373667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c3326adb-52a7-4585-aa96-3b9bbe4986bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:10.566573 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 868/1747] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:10.570841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116a46c-766e-4713-ab4f-6d3d3610ec94 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:10.582841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3326adb-52a7-4585-aa96-3b9bbe4986bc None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:10.592406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c3326adb-52a7-4585-aa96-3b9bbe4986bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:10.763584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116a46c-766e-4713-ab4f-6d3d3610ec94 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:10.787460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871392ae-7bf6-4c60-9b9f-8fa497088cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:10.790250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871392ae-7bf6-4c60-9b9f-8fa497088cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:10.790738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871392ae-7bf6-4c60-9b9f-8fa497088cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:10.791197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871392ae-7bf6-4c60-9b9f-8fa497088cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:10.793724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871392ae-7bf6-4c60-9b9f-8fa497088cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:10.798100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3326adb-52a7-4585-aa96-3b9bbe4986bc None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:10.799328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871392ae-7bf6-4c60-9b9f-8fa497088cc7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:10.810076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:10.816303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:10.817457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:10.817893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] PATH_INFO: `/v3/users/72f92a0901f74a00ae70677ad737afa9` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:10.819584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f92a0901f74a00ae70677ad737afa9)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:10.823989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:10.910070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 880/1748] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:10 2022] POST /identity/v3/projects => generated 375 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:10.911197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871392ae-7bf6-4c60-9b9f-8fa497088cc7 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:10.915962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-871392ae-7bf6-4c60-9b9f-8fa497088cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:11.043315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871392ae-7bf6-4c60-9b9f-8fa497088cc7 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:11.048744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a2b25-0d9e-4468-b39b-d3e1770b6d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:11.049650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a2b25-0d9e-4468-b39b-d3e1770b6d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:11.049933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a2b25-0d9e-4468-b39b-d3e1770b6d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:11.050211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a2b25-0d9e-4468-b39b-d3e1770b6d8f admin admin] PATH_INFO: `/v3/users/5cac7f6204134f788a8885b374b5d77e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:11.051500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a2b25-0d9e-4468-b39b-d3e1770b6d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cac7f6204134f788a8885b374b5d77e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:11.053486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a2b25-0d9e-4468-b39b-d3e1770b6d8f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:11.099941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f92a0901f74a00ae70677ad737afa9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:11.144944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f92a0901f74a00ae70677ad737afa9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:11.152806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f92a0901f74a00ae70677ad737afa9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:11.153851 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f92a0901f74a00ae70677ad737afa9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:11.300440 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f92a0901f74a00ae70677ad737afa9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:11.308425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 869/1749] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:10 2022] DELETE /identity/v3/users/72f92a0901f74a00ae70677ad737afa9 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:11.308425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:11.316804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:11.497889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc053b-f20a-4c9f-8f5d-327b511be26a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:11.522373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f759f-19eb-4b19-9f11-4ac5fd721b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:11.523430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f759f-19eb-4b19-9f11-4ac5fd721b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:11.524800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f759f-19eb-4b19-9f11-4ac5fd721b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:11.525321 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-595a2b25-0d9e-4468-b39b-d3e1770b6d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cac7f6204134f788a8885b374b5d77e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:11.527172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f759f-19eb-4b19-9f11-4ac5fd721b19 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:11.531510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f759f-19eb-4b19-9f11-4ac5fd721b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:11.534589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f759f-19eb-4b19-9f11-4ac5fd721b19 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:11.562187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-595a2b25-0d9e-4468-b39b-d3e1770b6d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cac7f6204134f788a8885b374b5d77e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:11.563100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-595a2b25-0d9e-4468-b39b-d3e1770b6d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cac7f6204134f788a8885b374b5d77e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:11.670416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-595a2b25-0d9e-4468-b39b-d3e1770b6d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cac7f6204134f788a8885b374b5d77e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:11.682459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 870/1750] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:11 2022] POST /identity/v3/users => generated 294 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:11.683504 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f759f-19eb-4b19-9f11-4ac5fd721b19 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:11.686637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-595a2b25-0d9e-4468-b39b-d3e1770b6d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cac7f6204134f788a8885b374b5d77e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:11.686812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f09f759f-19eb-4b19-9f11-4ac5fd721b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:11.696295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 881/1751] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:10 2022] DELETE /identity/v3/users/5cac7f6204134f788a8885b374b5d77e => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:11.708507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551b52-6b46-48c2-95a0-d4daa8471cba None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:11.711737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551b52-6b46-48c2-95a0-d4daa8471cba None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:11.711737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551b52-6b46-48c2-95a0-d4daa8471cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:11.711947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f759f-19eb-4b19-9f11-4ac5fd721b19 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:11.761234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-db551b52-6b46-48c2-95a0-d4daa8471cba None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:11.763968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-db551b52-6b46-48c2-95a0-d4daa8471cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:11.852475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:11.860046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:11.860404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:11.860691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] PATH_INFO: `/v3/projects/dfee22416d864723ab9cf3d9ad41f586` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:11.864120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfee22416d864723ab9cf3d9ad41f586)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:11.866949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:11.898542 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 882/1752] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:11.900599 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db551b52-6b46-48c2-95a0-d4daa8471cba None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:11.911467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-db551b52-6b46-48c2-95a0-d4daa8471cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:11.929885 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db551b52-6b46-48c2-95a0-d4daa8471cba None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:11.943191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e427b-f563-468b-a58b-509888010457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:11.946130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e427b-f563-468b-a58b-509888010457 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:11.946662 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e427b-f563-468b-a58b-509888010457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:11.948302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e427b-f563-468b-a58b-509888010457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:11.950551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e427b-f563-468b-a58b-509888010457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:11.954249 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e427b-f563-468b-a58b-509888010457 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:11.989308 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 883/1753] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:12.003287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3b05b-dede-4e20-8e12-fc85fb4e7799 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.003757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3b05b-dede-4e20-8e12-fc85fb4e7799 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.004137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3b05b-dede-4e20-8e12-fc85fb4e7799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.044896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-60c3b05b-dede-4e20-8e12-fc85fb4e7799 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:12.052148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-60c3b05b-dede-4e20-8e12-fc85fb4e7799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:12.053356 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfee22416d864723ab9cf3d9ad41f586', 'request_id': 'req-ea6d87f0-275a-41b3-96e0-27158935f39e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:12.075001 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfee22416d864723ab9cf3d9ad41f586', 'request_id': 'req-ea6d87f0-275a-41b3-96e0-27158935f39e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:12.164427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfee22416d864723ab9cf3d9ad41f586', 'request_id': 'req-ea6d87f0-275a-41b3-96e0-27158935f39e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:12.167258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 884/1754] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:12.168132 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3b05b-dede-4e20-8e12-fc85fb4e7799 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:12.172430 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-60c3b05b-dede-4e20-8e12-fc85fb4e7799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:12.205931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] The token cache is being invalidate because project dfee22416d864723ab9cf3d9ad41f586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:12.206549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:12.209076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:12.212516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 871/1755] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:11 2022] DELETE /identity/v3/projects/dfee22416d864723ab9cf3d9ad41f586 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:12.213578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:12.215632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:12.253366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d87f0-275a-41b3-96e0-27158935f39e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:12.257053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3b05b-dede-4e20-8e12-fc85fb4e7799 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:12.269709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bae732-da9c-4e25-ab42-3047d8487289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:12.270690 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae732-da9c-4e25-ab42-3047d8487289 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.270977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae732-da9c-4e25-ab42-3047d8487289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.271303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae732-da9c-4e25-ab42-3047d8487289 admin admin] PATH_INFO: `/v3/projects/bafa2ea73315479fbcc99b04e3ab2299/users/54c73533d8c04bc88398d96fa52f47ad/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.280876 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911456-095d-44a0-adee-6df22bd8075f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:12.281664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911456-095d-44a0-adee-6df22bd8075f service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.282069 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911456-095d-44a0-adee-6df22bd8075f service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.282448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911456-095d-44a0-adee-6df22bd8075f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.290269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-70911456-095d-44a0-adee-6df22bd8075f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:12.292687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bae732-da9c-4e25-ab42-3047d8487289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bafa2ea73315479fbcc99b04e3ab2299, user_id=54c73533d8c04bc88398d96fa52f47ad, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:12.295563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bae732-da9c-4e25-ab42-3047d8487289 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:12.308955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70911456-095d-44a0-adee-6df22bd8075f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:12.311027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70911456-095d-44a0-adee-6df22bd8075f service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:12.321616 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 885/1756] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:12.322338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911456-095d-44a0-adee-6df22bd8075f service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:12.323807 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-70911456-095d-44a0-adee-6df22bd8075f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:12.336008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911456-095d-44a0-adee-6df22bd8075f service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:12.340482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20a780-14ce-4bab-9297-3871ffa7bd74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:12.341144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a780-14ce-4bab-9297-3871ffa7bd74 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.341483 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a780-14ce-4bab-9297-3871ffa7bd74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.341767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a780-14ce-4bab-9297-3871ffa7bd74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.344090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-aa20a780-14ce-4bab-9297-3871ffa7bd74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:12.356905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20a780-14ce-4bab-9297-3871ffa7bd74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:12.361681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20a780-14ce-4bab-9297-3871ffa7bd74 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:12.370664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 886/1757] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:12.372607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215d92c-baff-4c48-ae01-b4b9020f6c3f None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.372607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215d92c-baff-4c48-ae01-b4b9020f6c3f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.372776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215d92c-baff-4c48-ae01-b4b9020f6c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.388022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 872/1758] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:12 2022] PUT /identity/v3/projects/bafa2ea73315479fbcc99b04e3ab2299/users/54c73533d8c04bc88398d96fa52f47ad/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:12.392681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bae732-da9c-4e25-ab42-3047d8487289 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:12.396957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c215d92c-baff-4c48-ae01-b4b9020f6c3f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:12.398643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c215d92c-baff-4c48-ae01-b4b9020f6c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:12.481993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bae732-da9c-4e25-ab42-3047d8487289 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:12.489679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12315d22-deab-46b6-b544-813b3493a9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:12.490922 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315d22-deab-46b6-b544-813b3493a9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.491477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315d22-deab-46b6-b544-813b3493a9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.491956 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315d22-deab-46b6-b544-813b3493a9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.492960 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12315d22-deab-46b6-b544-813b3493a9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:12.494385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 887/1759] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:12.495220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12315d22-deab-46b6-b544-813b3493a9ef admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:12.503902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7236b43-089e-44e7-b179-e3c3c5751933 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.504196 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7236b43-089e-44e7-b179-e3c3c5751933 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.504466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7236b43-089e-44e7-b179-e3c3c5751933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.512276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 873/1760] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:12.515358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12315d22-deab-46b6-b544-813b3493a9ef admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:12.530072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12315d22-deab-46b6-b544-813b3493a9ef admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:12.536474 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ee867-69a0-4fe7-9385-e0d5ee612d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:12.537656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee867-69a0-4fe7-9385-e0d5ee612d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.540914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee867-69a0-4fe7-9385-e0d5ee612d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.540914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee867-69a0-4fe7-9385-e0d5ee612d42 admin admin] PATH_INFO: `/v3/projects/bafa2ea73315479fbcc99b04e3ab2299/users/54c73533d8c04bc88398d96fa52f47ad/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.542217 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d7236b43-089e-44e7-b179-e3c3c5751933 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:12.542557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ee867-69a0-4fe7-9385-e0d5ee612d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bafa2ea73315479fbcc99b04e3ab2299, user_id=54c73533d8c04bc88398d96fa52f47ad, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:12.543475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d7236b43-089e-44e7-b179-e3c3c5751933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:12.545797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ee867-69a0-4fe7-9385-e0d5ee612d42 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:12.561265 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 874/1761] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:12 2022] PUT /identity/v3/projects/bafa2ea73315479fbcc99b04e3ab2299/users/54c73533d8c04bc88398d96fa52f47ad/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:12.575382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697777f-3edd-482e-8c88-e0e58cf41f6b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.575904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697777f-3edd-482e-8c88-e0e58cf41f6b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.576188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697777f-3edd-482e-8c88-e0e58cf41f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.579694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 888/1762] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:12.584224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7236b43-089e-44e7-b179-e3c3c5751933 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:12.601793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7236b43-089e-44e7-b179-e3c3c5751933 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:12.620285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5697777f-3edd-482e-8c88-e0e58cf41f6b None None] MFA Rules not processed for user `54c73533d8c04bc88398d96fa52f47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:12.621527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5697777f-3edd-482e-8c88-e0e58cf41f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:12.681803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17d560-5983-4e44-ac56-d6f870246016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:12.682492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d560-5983-4e44-ac56-d6f870246016 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.682780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d560-5983-4e44-ac56-d6f870246016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.683389 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d560-5983-4e44-ac56-d6f870246016 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.683846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17d560-5983-4e44-ac56-d6f870246016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:12.684158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17d560-5983-4e44-ac56-d6f870246016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:12.685789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17d560-5983-4e44-ac56-d6f870246016 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:12.709189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 889/1763] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:27:12.716008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17d560-5983-4e44-ac56-d6f870246016 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:12.729752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17d560-5983-4e44-ac56-d6f870246016 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:12.735944 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbde69-7e44-4c47-a4cc-88274408e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:12.737649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbde69-7e44-4c47-a4cc-88274408e3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.738261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbde69-7e44-4c47-a4cc-88274408e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.739190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbde69-7e44-4c47-a4cc-88274408e3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.740159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbde69-7e44-4c47-a4cc-88274408e3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:12.741833 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 875/1764] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:12.742326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbde69-7e44-4c47-a4cc-88274408e3e1 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:12.754733 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697777f-3edd-482e-8c88-e0e58cf41f6b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:12.756567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5697777f-3edd-482e-8c88-e0e58cf41f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:12.829398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697777f-3edd-482e-8c88-e0e58cf41f6b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:12.833992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff157af-8098-41a2-a849-494840d69e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:12.834802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff157af-8098-41a2-a849-494840d69e74 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:12.835266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff157af-8098-41a2-a849-494840d69e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:12.835849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff157af-8098-41a2-a849-494840d69e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:12.837502 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dff157af-8098-41a2-a849-494840d69e74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:12.856687 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 890/1765] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:12 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:12.861884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbde69-7e44-4c47-a4cc-88274408e3e1 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:12.945189 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff157af-8098-41a2-a849-494840d69e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:12.948903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff157af-8098-41a2-a849-494840d69e74 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:12.968511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbde69-7e44-4c47-a4cc-88274408e3e1 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:12.971374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 876/1766] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:27:12.992643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e4813-60bf-43cb-8875-bbfcbe284aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:13.002226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e4813-60bf-43cb-8875-bbfcbe284aef admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:13.002525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e4813-60bf-43cb-8875-bbfcbe284aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:13.002812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e4813-60bf-43cb-8875-bbfcbe284aef admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:13.003815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e4813-60bf-43cb-8875-bbfcbe284aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:13.005786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e4813-60bf-43cb-8875-bbfcbe284aef admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:13.107757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 891/1767] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:12 2022] POST /identity/v3/users => generated 282 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:13.111536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff157af-8098-41a2-a849-494840d69e74 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:13.126354 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff157af-8098-41a2-a849-494840d69e74 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:13.131672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a6226-fa86-40aa-b1e6-3962f1bf270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:13.132750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6226-fa86-40aa-b1e6-3962f1bf270e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:13.132925 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6226-fa86-40aa-b1e6-3962f1bf270e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:13.135248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6226-fa86-40aa-b1e6-3962f1bf270e admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:13.135248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a6226-fa86-40aa-b1e6-3962f1bf270e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:13.135624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a6226-fa86-40aa-b1e6-3962f1bf270e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:13.146423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 877/1768] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:13.154632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e4813-60bf-43cb-8875-bbfcbe284aef admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:13.165252 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e4813-60bf-43cb-8875-bbfcbe284aef admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:13.170078 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae3160-05e9-457c-abc9-e08a0131d2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:13.170767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae3160-05e9-457c-abc9-e08a0131d2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:13.171079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae3160-05e9-457c-abc9-e08a0131d2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:13.180709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae3160-05e9-457c-abc9-e08a0131d2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:13.180709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae3160-05e9-457c-abc9-e08a0131d2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:13.180709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae3160-05e9-457c-abc9-e08a0131d2b9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:13.184936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 892/1769] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:13.189253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a6226-fa86-40aa-b1e6-3962f1bf270e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:13.199207 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a6226-fa86-40aa-b1e6-3962f1bf270e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:13.207055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2669c5-7672-4c4f-ab4d-651c5886fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:13.207055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2669c5-7672-4c4f-ab4d-651c5886fb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:13.207055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2669c5-7672-4c4f-ab4d-651c5886fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:13.207055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2669c5-7672-4c4f-ab4d-651c5886fb88 admin admin] PATH_INFO: `/v3/projects/0b83aba17bd34f16b174d49a5bc25415/users/b1cd3d2693714051b6aac0afb530c180/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:13.209788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae3160-05e9-457c-abc9-e08a0131d2b9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:13.211566 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-31ae3160-05e9-457c-abc9-e08a0131d2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:13.224450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2669c5-7672-4c4f-ab4d-651c5886fb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b83aba17bd34f16b174d49a5bc25415, user_id=b1cd3d2693714051b6aac0afb530c180, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:13.228117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2669c5-7672-4c4f-ab4d-651c5886fb88 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:13.234077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae3160-05e9-457c-abc9-e08a0131d2b9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:13.236862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:13.238338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:13.238769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:13.239475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] PATH_INFO: `/v3/projects/3663d950aeb5452b8ce8566ebfe2bbff` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:13.241501 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3663d950aeb5452b8ce8566ebfe2bbff)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:13.243873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:13.301731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 878/1770] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:13 2022] PUT /identity/v3/projects/0b83aba17bd34f16b174d49a5bc25415/users/b1cd3d2693714051b6aac0afb530c180/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:13.302960 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2669c5-7672-4c4f-ab4d-651c5886fb88 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:13.306480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ca2669c5-7672-4c4f-ab4d-651c5886fb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:13.363338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3663d950aeb5452b8ce8566ebfe2bbff', 'request_id': 'req-b507ec29-5dd3-417b-8835-df2c9ff46923'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.368744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3663d950aeb5452b8ce8566ebfe2bbff', 'request_id': 'req-b507ec29-5dd3-417b-8835-df2c9ff46923'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.375414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2669c5-7672-4c4f-ab4d-651c5886fb88 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:13.426498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3663d950aeb5452b8ce8566ebfe2bbff', 'request_id': 'req-b507ec29-5dd3-417b-8835-df2c9ff46923'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.439929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] The token cache is being invalidate because project 3663d950aeb5452b8ce8566ebfe2bbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:13.440270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.440962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b507ec29-5dd3-417b-8835-df2c9ff46923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.442582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 893/1771] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:13 2022] DELETE /identity/v3/projects/3663d950aeb5452b8ce8566ebfe2bbff => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:13.443941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4a8a-6891-4226-8744-d7b349d22e68 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:13.444295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4a8a-6891-4226-8744-d7b349d22e68 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:13.444582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea4a8a-6891-4226-8744-d7b349d22e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:13.475601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-58ea4a8a-6891-4226-8744-d7b349d22e68 None None] MFA Rules not processed for user `b1cd3d2693714051b6aac0afb530c180`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:13.477305 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-58ea4a8a-6891-4226-8744-d7b349d22e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:13.548198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 894/1772] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:13.549060 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea4a8a-6891-4226-8744-d7b349d22e68 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:13.552622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-58ea4a8a-6891-4226-8744-d7b349d22e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:13.565125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:13.565930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:13.566212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:13.566489 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] PATH_INFO: `/v3/projects/30ec5d329c344a86804b8758e0fac618` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:13.567749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ec5d329c344a86804b8758e0fac618)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:13.569758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:13.635425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea4a8a-6891-4226-8744-d7b349d22e68 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:13.640069 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:13.640949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:13.641230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:13.641539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] PATH_INFO: `/v3/users/4278d4f88a1341db9ce17280e983b3e7` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:13.642771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4278d4f88a1341db9ce17280e983b3e7)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:13.644892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:13.699991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ec5d329c344a86804b8758e0fac618', 'request_id': 'req-49c9803e-effa-49fa-b0e1-fe10e273f449'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.706310 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ec5d329c344a86804b8758e0fac618', 'request_id': 'req-49c9803e-effa-49fa-b0e1-fe10e273f449'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.804322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ec5d329c344a86804b8758e0fac618', 'request_id': 'req-49c9803e-effa-49fa-b0e1-fe10e273f449'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.816732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] The token cache is being invalidate because project 30ec5d329c344a86804b8758e0fac618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:13.817022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.817687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.819452 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 879/1773] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:13 2022] DELETE /identity/v3/projects/30ec5d329c344a86804b8758e0fac618 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:13.820214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:13.821483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:13.873402 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4278d4f88a1341db9ce17280e983b3e7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.883425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9803e-effa-49fa-b0e1-fe10e273f449 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:13.884662 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4278d4f88a1341db9ce17280e983b3e7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.885315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4278d4f88a1341db9ce17280e983b3e7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.888416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f1f71-ee85-47c7-8f1b-7c5d068be93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:13.889220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f1f71-ee85-47c7-8f1b-7c5d068be93c admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:13.889339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f1f71-ee85-47c7-8f1b-7c5d068be93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:13.890132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f1f71-ee85-47c7-8f1b-7c5d068be93c admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:13.890821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f1f71-ee85-47c7-8f1b-7c5d068be93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:13.892812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f1f71-ee85-47c7-8f1b-7c5d068be93c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:13.964482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4278d4f88a1341db9ce17280e983b3e7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.972022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4278d4f88a1341db9ce17280e983b3e7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:13.978569 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 895/1774] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:13 2022] DELETE /identity/v3/users/4278d4f88a1341db9ce17280e983b3e7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:13.982467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:13.984694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:14.005859 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 880/1775] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:13 2022] POST /identity/v3/projects => generated 365 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:14.010290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f1f71-ee85-47c7-8f1b-7c5d068be93c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:14.025135 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1e7f1f71-ee85-47c7-8f1b-7c5d068be93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:14.078290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b24e5-a059-4407-b976-ba99ed36d013 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:14.132525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f1f71-ee85-47c7-8f1b-7c5d068be93c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:14.137666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b870e1-8cf5-4bdb-8dee-390fd9627f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:14.138458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b870e1-8cf5-4bdb-8dee-390fd9627f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:14.138902 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b870e1-8cf5-4bdb-8dee-390fd9627f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:14.139220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b870e1-8cf5-4bdb-8dee-390fd9627f3d admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:14.140472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b870e1-8cf5-4bdb-8dee-390fd9627f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:14.142423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b870e1-8cf5-4bdb-8dee-390fd9627f3d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:14.146378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:14.147380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:14.147736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:14.148107 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] PATH_INFO: `/v3/users/fb9eceef2dfa4e2d9596f0c907401ada` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:14.149450 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb9eceef2dfa4e2d9596f0c907401ada)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:14.151590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:14.240682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 881/1776] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:14 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:14.241608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b870e1-8cf5-4bdb-8dee-390fd9627f3d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:14.252359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b870e1-8cf5-4bdb-8dee-390fd9627f3d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:14.260600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94409-f87e-4a2b-9a75-240b4abfbf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:14.261290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94409-f87e-4a2b-9a75-240b4abfbf88 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:14.261593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94409-f87e-4a2b-9a75-240b4abfbf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:14.261856 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94409-f87e-4a2b-9a75-240b4abfbf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:14.263159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae94409-f87e-4a2b-9a75-240b4abfbf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:14.264327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae94409-f87e-4a2b-9a75-240b4abfbf88 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:14.278950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 882/1777] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:14.283448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94409-f87e-4a2b-9a75-240b4abfbf88 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:14.291268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94409-f87e-4a2b-9a75-240b4abfbf88 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:14.296512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee23e5-81e3-41d9-afee-47f715053f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:14.297427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee23e5-81e3-41d9-afee-47f715053f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:14.297732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee23e5-81e3-41d9-afee-47f715053f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:14.298196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee23e5-81e3-41d9-afee-47f715053f31 admin admin] PATH_INFO: `/v3/projects/5b0f0262ce9e45569142bc490c98693c/users/a71bf22300d94cbeaa99991f0fe06f92/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:14.315513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee23e5-81e3-41d9-afee-47f715053f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0f0262ce9e45569142bc490c98693c, user_id=a71bf22300d94cbeaa99991f0fe06f92, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:14.318288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee23e5-81e3-41d9-afee-47f715053f31 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:14.343732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb9eceef2dfa4e2d9596f0c907401ada'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:14.355226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb9eceef2dfa4e2d9596f0c907401ada'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:14.356027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb9eceef2dfa4e2d9596f0c907401ada'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:14.380892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 883/1778] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:14 2022] PUT /identity/v3/projects/5b0f0262ce9e45569142bc490c98693c/users/a71bf22300d94cbeaa99991f0fe06f92/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:14.384695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee23e5-81e3-41d9-afee-47f715053f31 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:14.425393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb9eceef2dfa4e2d9596f0c907401ada'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:14.434353 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb9eceef2dfa4e2d9596f0c907401ada'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:14.442033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 896/1779] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:13 2022] DELETE /identity/v3/users/fb9eceef2dfa4e2d9596f0c907401ada => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:14.447379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee23e5-81e3-41d9-afee-47f715053f31 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:14.511295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd824e-50bb-4b50-bf91-675153fac0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:14.512415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd824e-50bb-4b50-bf91-675153fac0dd admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:14.512839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd824e-50bb-4b50-bf91-675153fac0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:14.513130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd824e-50bb-4b50-bf91-675153fac0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:14.513857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd824e-50bb-4b50-bf91-675153fac0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:14.515671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd824e-50bb-4b50-bf91-675153fac0dd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:14.529323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 884/1780] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:14.531200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:14.532728 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:14.547717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e544cbf-d907-45b8-b225-d81210c7969d admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:14.554163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de99157-4255-4009-b627-17677441edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:14.555238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de99157-4255-4009-b627-17677441edd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:14.555595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de99157-4255-4009-b627-17677441edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:14.555952 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de99157-4255-4009-b627-17677441edd0 admin admin] PATH_INFO: `/v3/projects/5b0f0262ce9e45569142bc490c98693c/users/a71bf22300d94cbeaa99991f0fe06f92/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:14.558122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de99157-4255-4009-b627-17677441edd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0f0262ce9e45569142bc490c98693c, user_id=a71bf22300d94cbeaa99991f0fe06f92, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:14.561958 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de99157-4255-4009-b627-17677441edd0 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:14.583990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 897/1781] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:14 2022] PUT /identity/v3/projects/5b0f0262ce9e45569142bc490c98693c/users/a71bf22300d94cbeaa99991f0fe06f92/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:14.585904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14fb66-7c16-46f0-af16-bfcbb320620a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:14.586236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14fb66-7c16-46f0-af16-bfcbb320620a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:14.587011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14fb66-7c16-46f0-af16-bfcbb320620a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:14.618374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ae14fb66-7c16-46f0-af16-bfcbb320620a None None] MFA Rules not processed for user `a71bf22300d94cbeaa99991f0fe06f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:14.620849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ae14fb66-7c16-46f0-af16-bfcbb320620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:14.696409 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 885/1782] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:14.712954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de99157-4255-4009-b627-17677441edd0 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:14.715318 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8de99157-4255-4009-b627-17677441edd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:14.809085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de99157-4255-4009-b627-17677441edd0 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:14.812959 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c6f6-15ea-4783-8d3f-8a2bb1bf2586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:14.813889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c6f6-15ea-4783-8d3f-8a2bb1bf2586 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:14.814169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c6f6-15ea-4783-8d3f-8a2bb1bf2586 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:14.814442 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c6f6-15ea-4783-8d3f-8a2bb1bf2586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:14.824165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33c6f6-15ea-4783-8d3f-8a2bb1bf2586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:14.825764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33c6f6-15ea-4783-8d3f-8a2bb1bf2586 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:14.834668 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14fb66-7c16-46f0-af16-bfcbb320620a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:14.836332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ae14fb66-7c16-46f0-af16-bfcbb320620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:14.863496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 898/1783] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:14.941184 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14fb66-7c16-46f0-af16-bfcbb320620a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:14.946014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:14.952697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:14.952697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:14.952697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] PATH_INFO: `/v3/projects/2d56b009af414e1fa645994f418cd06a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:14.952697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d56b009af414e1fa645994f418cd06a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:14.952697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:15.088480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d56b009af414e1fa645994f418cd06a', 'request_id': 'req-84eecd3a-7439-40b4-99c9-d086d89f4147'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:15.093950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d56b009af414e1fa645994f418cd06a', 'request_id': 'req-84eecd3a-7439-40b4-99c9-d086d89f4147'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:15.126697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c6f6-15ea-4783-8d3f-8a2bb1bf2586 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:15.128268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ef33c6f6-15ea-4783-8d3f-8a2bb1bf2586 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:15.145116 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c6f6-15ea-4783-8d3f-8a2bb1bf2586 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:15.174796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d56b009af414e1fa645994f418cd06a', 'request_id': 'req-84eecd3a-7439-40b4-99c9-d086d89f4147'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:15.188111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] The token cache is being invalidate because project 2d56b009af414e1fa645994f418cd06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:15.188401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:15.189082 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:15.190670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 886/1784] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:14 2022] DELETE /identity/v3/projects/2d56b009af414e1fa645994f418cd06a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:15.191976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:15.193316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:15.206878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:15.208440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.208801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.209177 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] PATH_INFO: `/v3/projects/381c041f1a7e4b4ab726b69646180b28` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.210502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=381c041f1a7e4b4ab726b69646180b28)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:15.212584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:15.253836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eecd3a-7439-40b4-99c9-d086d89f4147 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:15.257816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b408a6e-5441-44ef-8770-e84d32d486da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:15.258480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b408a6e-5441-44ef-8770-e84d32d486da service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.258758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b408a6e-5441-44ef-8770-e84d32d486da service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.259029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b408a6e-5441-44ef-8770-e84d32d486da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.261020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4b408a6e-5441-44ef-8770-e84d32d486da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:15.324662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b408a6e-5441-44ef-8770-e84d32d486da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:15.326516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b408a6e-5441-44ef-8770-e84d32d486da service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:15.338166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 887/1785] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:15.339057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381c041f1a7e4b4ab726b69646180b28', 'request_id': 'req-1733e42a-a43b-4357-83f7-0fff2f424e77'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:15.339653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239cc5d-ffe6-459d-8ba0-b55d567bbe5e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.339941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239cc5d-ffe6-459d-8ba0-b55d567bbe5e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.340225 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239cc5d-ffe6-459d-8ba0-b55d567bbe5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.353679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381c041f1a7e4b4ab726b69646180b28', 'request_id': 'req-1733e42a-a43b-4357-83f7-0fff2f424e77'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:15.359083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e239cc5d-ffe6-459d-8ba0-b55d567bbe5e None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:15.360338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e239cc5d-ffe6-459d-8ba0-b55d567bbe5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:15.439064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381c041f1a7e4b4ab726b69646180b28', 'request_id': 'req-1733e42a-a43b-4357-83f7-0fff2f424e77'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:15.459842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] The token cache is being invalidate because project 381c041f1a7e4b4ab726b69646180b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:15.460306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:15.461235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1733e42a-a43b-4357-83f7-0fff2f424e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:15.463370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 899/1786] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:15 2022] DELETE /identity/v3/projects/381c041f1a7e4b4ab726b69646180b28 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:15.468458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 888/1787] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:15.468830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1f719-0596-4a07-ba89-d19ced820c52 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.469271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1f719-0596-4a07-ba89-d19ced820c52 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.469747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1f719-0596-4a07-ba89-d19ced820c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.475758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9490e-9c08-499f-9c74-92b466cd4dd7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.475758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9490e-9c08-499f-9c74-92b466cd4dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.475758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9490e-9c08-499f-9c74-92b466cd4dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.493024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d0f1f719-0596-4a07-ba89-d19ced820c52 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:15.494278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d0f1f719-0596-4a07-ba89-d19ced820c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:15.511267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 900/1788] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:15.513072 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d36d-e8bc-4825-886d-4ff8c315a1db None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.513371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d36d-e8bc-4825-886d-4ff8c315a1db None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.513650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d36d-e8bc-4825-886d-4ff8c315a1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.516733 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8eb9490e-9c08-499f-9c74-92b466cd4dd7 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:15.517966 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8eb9490e-9c08-499f-9c74-92b466cd4dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:15.533123 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-7c45d36d-e8bc-4825-886d-4ff8c315a1db None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:15.534474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7c45d36d-e8bc-4825-886d-4ff8c315a1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:15.538955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 889/1789] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:15.547623 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9490e-9c08-499f-9c74-92b466cd4dd7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:15.549001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 901/1790] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:15.553226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d36d-e8bc-4825-886d-4ff8c315a1db None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:15.564018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9490e-9c08-499f-9c74-92b466cd4dd7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:15.565284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d36d-e8bc-4825-886d-4ff8c315a1db None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:15.569802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6920-47b0-49e2-a5d0-0037b7e6210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:15.570533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6920-47b0-49e2-a5d0-0037b7e6210c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.582902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c18eaa-ae75-4870-ba14-0d1bdeaf44bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:15.583349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6920-47b0-49e2-a5d0-0037b7e6210c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.583349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6920-47b0-49e2-a5d0-0037b7e6210c admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.583349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6920-47b0-49e2-a5d0-0037b7e6210c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:15.583349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6920-47b0-49e2-a5d0-0037b7e6210c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:15.583349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6920-47b0-49e2-a5d0-0037b7e6210c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:15.583668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18eaa-ae75-4870-ba14-0d1bdeaf44bd admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.583668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18eaa-ae75-4870-ba14-0d1bdeaf44bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.583668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18eaa-ae75-4870-ba14-0d1bdeaf44bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.583668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18eaa-ae75-4870-ba14-0d1bdeaf44bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:15.583668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18eaa-ae75-4870-ba14-0d1bdeaf44bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:15.583668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18eaa-ae75-4870-ba14-0d1bdeaf44bd admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:15.592537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 890/1791] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:27:15.597397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6920-47b0-49e2-a5d0-0037b7e6210c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:15.601169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 902/1792] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:27:15.605187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c18eaa-ae75-4870-ba14-0d1bdeaf44bd admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:15.607844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6920-47b0-49e2-a5d0-0037b7e6210c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:15.613099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264042b6-6dda-4324-90fb-fafce9e1d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:15.613751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264042b6-6dda-4324-90fb-fafce9e1d0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.614078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264042b6-6dda-4324-90fb-fafce9e1d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.614314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264042b6-6dda-4324-90fb-fafce9e1d0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.615027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264042b6-6dda-4324-90fb-fafce9e1d0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:15.615463 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c18eaa-ae75-4870-ba14-0d1bdeaf44bd admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:15.617023 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264042b6-6dda-4324-90fb-fafce9e1d0d7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:15.620288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6cbf5-8a76-42a3-9bbc-2265b0b51b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:15.620935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6cbf5-8a76-42a3-9bbc-2265b0b51b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.621222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6cbf5-8a76-42a3-9bbc-2265b0b51b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.621505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6cbf5-8a76-42a3-9bbc-2265b0b51b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.622194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6cbf5-8a76-42a3-9bbc-2265b0b51b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:15.624697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6cbf5-8a76-42a3-9bbc-2265b0b51b8a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:15.729178 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 903/1794] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:15 2022] POST /identity/v3/projects => generated 363 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:15.729368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 891/1794] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:15 2022] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:15.730468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6cbf5-8a76-42a3-9bbc-2265b0b51b8a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:15.731182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264042b6-6dda-4324-90fb-fafce9e1d0d7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:15.835076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264042b6-6dda-4324-90fb-fafce9e1d0d7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:15.850649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efa26a-465e-4e6e-bb20-f4d49177f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:15.851446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa26a-465e-4e6e-bb20-f4d49177f064 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.852080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa26a-465e-4e6e-bb20-f4d49177f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.852369 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa26a-465e-4e6e-bb20-f4d49177f064 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.853067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efa26a-465e-4e6e-bb20-f4d49177f064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:15.855248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efa26a-465e-4e6e-bb20-f4d49177f064 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:15.862267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6cbf5-8a76-42a3-9bbc-2265b0b51b8a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:15.879697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a75b3a-5859-4195-9b73-2799700e3f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:15.884732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a75b3a-5859-4195-9b73-2799700e3f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.884732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a75b3a-5859-4195-9b73-2799700e3f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:15.884732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a75b3a-5859-4195-9b73-2799700e3f91 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:15.884732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a75b3a-5859-4195-9b73-2799700e3f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:15.884732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a75b3a-5859-4195-9b73-2799700e3f91 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:15.971162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 904/1795] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:15 2022] POST /identity/v3/users => generated 282 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:15.976569 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a75b3a-5859-4195-9b73-2799700e3f91 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:15.977303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 892/1796] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:15 2022] POST /identity/v3/users => generated 278 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:15.983014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efa26a-465e-4e6e-bb20-f4d49177f064 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:15.991812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a75b3a-5859-4195-9b73-2799700e3f91 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:15.998248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fd5b0-4d04-44b9-9616-33982a46b9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:15.999262 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd5b0-4d04-44b9-9616-33982a46b9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:15.999690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd5b0-4d04-44b9-9616-33982a46b9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.000740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd5b0-4d04-44b9-9616-33982a46b9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.001762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fd5b0-4d04-44b9-9616-33982a46b9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:16.003513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fd5b0-4d04-44b9-9616-33982a46b9e5 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:16.018078 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 905/1797] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:16.018985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efa26a-465e-4e6e-bb20-f4d49177f064 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:16.022427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fd5b0-4d04-44b9-9616-33982a46b9e5 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:16.033696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ba854-74b7-49e3-897b-f9471aad5866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:16.038979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ba854-74b7-49e3-897b-f9471aad5866 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:16.038979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ba854-74b7-49e3-897b-f9471aad5866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.038979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ba854-74b7-49e3-897b-f9471aad5866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.038979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ba854-74b7-49e3-897b-f9471aad5866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:16.038979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ba854-74b7-49e3-897b-f9471aad5866 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:16.039593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fd5b0-4d04-44b9-9616-33982a46b9e5 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:16.044056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06518f25-a94a-4c2d-aa58-c64b0e32f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:16.044803 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518f25-a94a-4c2d-aa58-c64b0e32f339 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:16.045151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518f25-a94a-4c2d-aa58-c64b0e32f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.045431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518f25-a94a-4c2d-aa58-c64b0e32f339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.046913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06518f25-a94a-4c2d-aa58-c64b0e32f339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:16.049241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06518f25-a94a-4c2d-aa58-c64b0e32f339 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:16.052292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 893/1798] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:16.053267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ba854-74b7-49e3-897b-f9471aad5866 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:16.063569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ba854-74b7-49e3-897b-f9471aad5866 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:16.064764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 906/1799] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:16.068628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edfa95-e3cb-4522-ae5e-a16aeca18d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:16.069359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edfa95-e3cb-4522-ae5e-a16aeca18d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:16.069644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edfa95-e3cb-4522-ae5e-a16aeca18d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.069915 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edfa95-e3cb-4522-ae5e-a16aeca18d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.070882 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edfa95-e3cb-4522-ae5e-a16aeca18d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:16.072088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06518f25-a94a-4c2d-aa58-c64b0e32f339 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:16.072681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edfa95-e3cb-4522-ae5e-a16aeca18d2c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:16.081678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06518f25-a94a-4c2d-aa58-c64b0e32f339 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:16.087446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 894/1800] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:16.089620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c2e13-99b2-4b0f-9e7d-8ad66535bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:16.090530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c2e13-99b2-4b0f-9e7d-8ad66535bb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:16.091432 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c2e13-99b2-4b0f-9e7d-8ad66535bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.091809 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c2e13-99b2-4b0f-9e7d-8ad66535bb83 admin admin] PATH_INFO: `/v3/projects/3affaf4afdbc42f98b0c6c0507502f7c/users/0fde5541fc92404fbdb325edd923039a/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.095740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edfa95-e3cb-4522-ae5e-a16aeca18d2c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:16.107849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edfa95-e3cb-4522-ae5e-a16aeca18d2c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:16.117264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c2e13-99b2-4b0f-9e7d-8ad66535bb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3affaf4afdbc42f98b0c6c0507502f7c, user_id=0fde5541fc92404fbdb325edd923039a, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:16.120206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cc318-1bf2-409f-8705-892beba12461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:16.120352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c2e13-99b2-4b0f-9e7d-8ad66535bb83 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:16.121238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc318-1bf2-409f-8705-892beba12461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:16.121515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc318-1bf2-409f-8705-892beba12461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.122235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc318-1bf2-409f-8705-892beba12461 admin admin] PATH_INFO: `/v3/projects/6e4f13950b364baebe7ea996f9165748/users/362d85d17b9049a9b096c80063f7411f/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.136955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cc318-1bf2-409f-8705-892beba12461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4f13950b364baebe7ea996f9165748, user_id=362d85d17b9049a9b096c80063f7411f, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:16.140310 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cc318-1bf2-409f-8705-892beba12461 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:16.215118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 895/1801] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:16 2022] PUT /identity/v3/projects/6e4f13950b364baebe7ea996f9165748/users/362d85d17b9049a9b096c80063f7411f/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:16.215625 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 907/1802] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:16 2022] PUT /identity/v3/projects/3affaf4afdbc42f98b0c6c0507502f7c/users/0fde5541fc92404fbdb325edd923039a/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:16.226437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59859a8b-d3c1-4041-ab38-ac3abd64b555 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:16.226581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b2d1f-9203-4032-b1b2-cf9f367bc47b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:16.226724 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59859a8b-d3c1-4041-ab38-ac3abd64b555 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.226925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b2d1f-9203-4032-b1b2-cf9f367bc47b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.227014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59859a8b-d3c1-4041-ab38-ac3abd64b555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.227103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b2d1f-9203-4032-b1b2-cf9f367bc47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.252743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-0a7b2d1f-9203-4032-b1b2-cf9f367bc47b None None] MFA Rules not processed for user `0fde5541fc92404fbdb325edd923039a`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:16.253648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-59859a8b-d3c1-4041-ab38-ac3abd64b555 None None] MFA Rules not processed for user `362d85d17b9049a9b096c80063f7411f`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:16.254093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0a7b2d1f-9203-4032-b1b2-cf9f367bc47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:16.254816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-59859a8b-d3c1-4041-ab38-ac3abd64b555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:16.328671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 908/1803] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:16.338257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b2d1f-9203-4032-b1b2-cf9f367bc47b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:16.348355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 896/1804] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:16.352716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59859a8b-d3c1-4041-ab38-ac3abd64b555 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:16.401082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b2d1f-9203-4032-b1b2-cf9f367bc47b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:16.407416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c810a1-a627-4d18-9902-e2fae3773c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:16.408071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c810a1-a627-4d18-9902-e2fae3773c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:16.410343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c810a1-a627-4d18-9902-e2fae3773c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.410343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c810a1-a627-4d18-9902-e2fae3773c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.410343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c810a1-a627-4d18-9902-e2fae3773c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:16.411414 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c810a1-a627-4d18-9902-e2fae3773c87 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:16.413710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59859a8b-d3c1-4041-ab38-ac3abd64b555 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:16.418319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bf53f-7535-4311-a535-6e54808313f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:16.418986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bf53f-7535-4311-a535-6e54808313f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:16.419296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bf53f-7535-4311-a535-6e54808313f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.419572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bf53f-7535-4311-a535-6e54808313f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.420261 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bf53f-7535-4311-a535-6e54808313f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:16.422214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bf53f-7535-4311-a535-6e54808313f6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:16.522594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 897/1806] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:16 2022] POST /identity/v3/projects => generated 357 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:16.522783 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 909/1806] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:16 2022] POST /identity/v3/projects => generated 363 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:16.524060 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c810a1-a627-4d18-9902-e2fae3773c87 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:16.525035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bf53f-7535-4311-a535-6e54808313f6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:16.588659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bf53f-7535-4311-a535-6e54808313f6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:16.593747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d29dc7-498b-49d5-8253-3d257adc5e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:16.594485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d29dc7-498b-49d5-8253-3d257adc5e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:16.594824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d29dc7-498b-49d5-8253-3d257adc5e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.594987 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d29dc7-498b-49d5-8253-3d257adc5e5b admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.595751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d29dc7-498b-49d5-8253-3d257adc5e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:16.598106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d29dc7-498b-49d5-8253-3d257adc5e5b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:16.599821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c810a1-a627-4d18-9902-e2fae3773c87 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:16.604820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f91da-6353-4fe4-977b-fedd27fd023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:16.605548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f91da-6353-4fe4-977b-fedd27fd023b admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:16.605893 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f91da-6353-4fe4-977b-fedd27fd023b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:16.606382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f91da-6353-4fe4-977b-fedd27fd023b admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:16.607407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f91da-6353-4fe4-977b-fedd27fd023b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:16.610660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f91da-6353-4fe4-977b-fedd27fd023b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:17.772554 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 898/1807] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:16 2022] POST /identity/v3/users => generated 288 bytes in 1246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:17.773825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d29dc7-498b-49d5-8253-3d257adc5e5b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:17.784612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d29dc7-498b-49d5-8253-3d257adc5e5b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:17.793316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708e9b-711f-4022-99ab-6cc147e71426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:17.793316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708e9b-711f-4022-99ab-6cc147e71426 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:17.793316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708e9b-711f-4022-99ab-6cc147e71426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:17.793316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708e9b-711f-4022-99ab-6cc147e71426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:17.793666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708e9b-711f-4022-99ab-6cc147e71426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:17.796933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 910/1808] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:16 2022] POST /identity/v3/users => generated 285 bytes in 1273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:17.798094 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708e9b-711f-4022-99ab-6cc147e71426 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:17.800538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f91da-6353-4fe4-977b-fedd27fd023b admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:17.816078 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f91da-6353-4fe4-977b-fedd27fd023b admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:17.821026 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 899/1809] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:17.824292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708e9b-711f-4022-99ab-6cc147e71426 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:17.827649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0a464-81b4-4124-bff4-d52c394f9264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:17.828044 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a464-81b4-4124-bff4-d52c394f9264 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:17.831904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a464-81b4-4124-bff4-d52c394f9264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:17.831904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a464-81b4-4124-bff4-d52c394f9264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:17.831904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0a464-81b4-4124-bff4-d52c394f9264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:17.831904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0a464-81b4-4124-bff4-d52c394f9264 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:17.844979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 911/1810] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:17.849064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0a464-81b4-4124-bff4-d52c394f9264 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:17.851162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708e9b-711f-4022-99ab-6cc147e71426 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:17.855486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e237a7-1e80-4df4-9b8d-c7d78b20a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:17.857069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e237a7-1e80-4df4-9b8d-c7d78b20a1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:17.857069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e237a7-1e80-4df4-9b8d-c7d78b20a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:17.857288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e237a7-1e80-4df4-9b8d-c7d78b20a1a6 admin admin] PATH_INFO: `/v3/projects/42ac4003e8104f5d9b12ec5e39fe6341/users/4975c91f1cee40cab0931a20bc5baed1/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:17.865247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0a464-81b4-4124-bff4-d52c394f9264 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:17.870174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90b6c-02d5-4927-a638-5b2e078f5aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:17.871322 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90b6c-02d5-4927-a638-5b2e078f5aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:17.871715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90b6c-02d5-4927-a638-5b2e078f5aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:17.872097 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90b6c-02d5-4927-a638-5b2e078f5aea admin admin] PATH_INFO: `/v3/projects/ded0eeba6dda4c32b62cd539396e59d8/users/0a52f57f034f4cca8ffef688c6950179/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:17.878445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e237a7-1e80-4df4-9b8d-c7d78b20a1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ac4003e8104f5d9b12ec5e39fe6341, user_id=4975c91f1cee40cab0931a20bc5baed1, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:17.881196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e237a7-1e80-4df4-9b8d-c7d78b20a1a6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:17.889414 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad90b6c-02d5-4927-a638-5b2e078f5aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded0eeba6dda4c32b62cd539396e59d8, user_id=0a52f57f034f4cca8ffef688c6950179, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:17.892920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad90b6c-02d5-4927-a638-5b2e078f5aea admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:18.010073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 900/1811] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:17 2022] PUT /identity/v3/projects/42ac4003e8104f5d9b12ec5e39fe6341/users/4975c91f1cee40cab0931a20bc5baed1/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:18.018428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e237a7-1e80-4df4-9b8d-c7d78b20a1a6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:18.072651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 912/1812] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:17 2022] PUT /identity/v3/projects/ded0eeba6dda4c32b62cd539396e59d8/users/0a52f57f034f4cca8ffef688c6950179/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:18.076567 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90b6c-02d5-4927-a638-5b2e078f5aea admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:18.093926 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e237a7-1e80-4df4-9b8d-c7d78b20a1a6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:18.171714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90b6c-02d5-4927-a638-5b2e078f5aea admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:18.177826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6929b-99fe-42de-84bf-1a8b5a0d8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:18.181813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6929b-99fe-42de-84bf-1a8b5a0d8b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:18.181813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6929b-99fe-42de-84bf-1a8b5a0d8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:18.181813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6929b-99fe-42de-84bf-1a8b5a0d8b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:18.182060 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6929b-99fe-42de-84bf-1a8b5a0d8b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:18.183976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6929b-99fe-42de-84bf-1a8b5a0d8b63 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:18.185246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5956b-500a-49df-bebe-75f8c64404f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:18.186001 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5956b-500a-49df-bebe-75f8c64404f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:18.186876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5956b-500a-49df-bebe-75f8c64404f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:18.187366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5956b-500a-49df-bebe-75f8c64404f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:18.188209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5956b-500a-49df-bebe-75f8c64404f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:18.190130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5956b-500a-49df-bebe-75f8c64404f3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:18.204283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 913/1813] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:18.204749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 901/1814] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:18.204883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6929b-99fe-42de-84bf-1a8b5a0d8b63 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:18.205659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5956b-500a-49df-bebe-75f8c64404f3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:18.217055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6929b-99fe-42de-84bf-1a8b5a0d8b63 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:18.218563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5956b-500a-49df-bebe-75f8c64404f3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:18.222789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050a372-c946-49dc-9b4c-37017a8353a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:18.224041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a372-c946-49dc-9b4c-37017a8353a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:18.224153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd7d80-84d1-4838-9cfc-5dbadce9fe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:18.224579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a372-c946-49dc-9b4c-37017a8353a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:18.225007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a372-c946-49dc-9b4c-37017a8353a4 admin admin] PATH_INFO: `/v3/projects/ded0eeba6dda4c32b62cd539396e59d8/users/0a52f57f034f4cca8ffef688c6950179/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:18.230937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd7d80-84d1-4838-9cfc-5dbadce9fe2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:18.230937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd7d80-84d1-4838-9cfc-5dbadce9fe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:18.230937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd7d80-84d1-4838-9cfc-5dbadce9fe2c admin admin] PATH_INFO: `/v3/projects/42ac4003e8104f5d9b12ec5e39fe6341/users/4975c91f1cee40cab0931a20bc5baed1/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:18.231671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050a372-c946-49dc-9b4c-37017a8353a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded0eeba6dda4c32b62cd539396e59d8, user_id=0a52f57f034f4cca8ffef688c6950179, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:18.231671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050a372-c946-49dc-9b4c-37017a8353a4 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:18.233853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd7d80-84d1-4838-9cfc-5dbadce9fe2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ac4003e8104f5d9b12ec5e39fe6341, user_id=4975c91f1cee40cab0931a20bc5baed1, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:18.238541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd7d80-84d1-4838-9cfc-5dbadce9fe2c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:18.249422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 914/1815] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:18 2022] PUT /identity/v3/projects/ded0eeba6dda4c32b62cd539396e59d8/users/0a52f57f034f4cca8ffef688c6950179/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:18.257138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 902/1816] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:18 2022] PUT /identity/v3/projects/42ac4003e8104f5d9b12ec5e39fe6341/users/4975c91f1cee40cab0931a20bc5baed1/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:18.269793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b683c-d86b-48e8-be23-75c7ea33c639 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:18.270093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b683c-d86b-48e8-be23-75c7ea33c639 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:18.270381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b683c-d86b-48e8-be23-75c7ea33c639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:18.294325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414faba7-0dc9-4f3d-9c3d-15e897e8e203 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:18.294325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414faba7-0dc9-4f3d-9c3d-15e897e8e203 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:18.294325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414faba7-0dc9-4f3d-9c3d-15e897e8e203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:18.310551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-9f5b683c-d86b-48e8-be23-75c7ea33c639 None None] MFA Rules not processed for user `4975c91f1cee40cab0931a20bc5baed1`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:18.312485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-9f5b683c-d86b-48e8-be23-75c7ea33c639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:18.312935 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-414faba7-0dc9-4f3d-9c3d-15e897e8e203 None None] MFA Rules not processed for user `0a52f57f034f4cca8ffef688c6950179`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:18.314403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-414faba7-0dc9-4f3d-9c3d-15e897e8e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:18.411480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 915/1817] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:18.426251 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b683c-d86b-48e8-be23-75c7ea33c639 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:18.429239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-9f5b683c-d86b-48e8-be23-75c7ea33c639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:18.433665 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 903/1818] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:18 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:18.491383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b683c-d86b-48e8-be23-75c7ea33c639 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:18.495047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc70ea-7dd1-4d8b-baf7-00d96da2c2b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:18.495731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc70ea-7dd1-4d8b-baf7-00d96da2c2b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:18.496016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc70ea-7dd1-4d8b-baf7-00d96da2c2b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:18.496290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc70ea-7dd1-4d8b-baf7-00d96da2c2b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:18.509039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414faba7-0dc9-4f3d-9c3d-15e897e8e203 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:18.509278 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-414faba7-0dc9-4f3d-9c3d-15e897e8e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:18.517226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc70ea-7dd1-4d8b-baf7-00d96da2c2b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:18.518745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc70ea-7dd1-4d8b-baf7-00d96da2c2b5 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:18.521725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414faba7-0dc9-4f3d-9c3d-15e897e8e203 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:18.525533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ef63e-770f-49c3-ab98-7767677bc17f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:18.526204 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ef63e-770f-49c3-ab98-7767677bc17f service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:18.526487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ef63e-770f-49c3-ab98-7767677bc17f service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:18.526848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ef63e-770f-49c3-ab98-7767677bc17f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:18.529183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 916/1819] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:27:18.539168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ef63e-770f-49c3-ab98-7767677bc17f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:18.540903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ef63e-770f-49c3-ab98-7767677bc17f service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:18.551600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 904/1820] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:18 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:27:18.760841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc70ea-7dd1-4d8b-baf7-00d96da2c2b5 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:18.774539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc70ea-7dd1-4d8b-baf7-00d96da2c2b5 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:18.778609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f6b0b-1fb4-4bc2-bfb6-b5bdf0471249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:18.779299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f6b0b-1fb4-4bc2-bfb6-b5bdf0471249 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:18.779586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f6b0b-1fb4-4bc2-bfb6-b5bdf0471249 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:18.779867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f6b0b-1fb4-4bc2-bfb6-b5bdf0471249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:18.790570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ef63e-770f-49c3-ab98-7767677bc17f service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:18.799827 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ef63e-770f-49c3-ab98-7767677bc17f service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:18.803562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a5e9a-50b4-4b0e-b31c-4da04fd5aac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:18.804200 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a5e9a-50b4-4b0e-b31c-4da04fd5aac7 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:18.804480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a5e9a-50b4-4b0e-b31c-4da04fd5aac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:18.804752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a5e9a-50b4-4b0e-b31c-4da04fd5aac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:18.840214 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f6b0b-1fb4-4bc2-bfb6-b5bdf0471249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:18.840214 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f6b0b-1fb4-4bc2-bfb6-b5bdf0471249 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:18.850431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 917/1821] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:18.868300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a5e9a-50b4-4b0e-b31c-4da04fd5aac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:18.868300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a5e9a-50b4-4b0e-b31c-4da04fd5aac7 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:18.877455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 905/1822] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:18 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:27:19.924679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f6b0b-1fb4-4bc2-bfb6-b5bdf0471249 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:19.926151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-887f6b0b-1fb4-4bc2-bfb6-b5bdf0471249 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:19.991365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f6b0b-1fb4-4bc2-bfb6-b5bdf0471249 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:19.996023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:19.996943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:19.997224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:19.997499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] PATH_INFO: `/v3/users/b1cd3d2693714051b6aac0afb530c180` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:20.001111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1cd3d2693714051b6aac0afb530c180)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:20.003100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:20.221061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1cd3d2693714051b6aac0afb530c180'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:20.239181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1cd3d2693714051b6aac0afb530c180'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:20.240128 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1cd3d2693714051b6aac0afb530c180'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:20.335518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1cd3d2693714051b6aac0afb530c180'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:20.345219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1cd3d2693714051b6aac0afb530c180'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:20.361576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 918/1823] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:19 2022] DELETE /identity/v3/users/b1cd3d2693714051b6aac0afb530c180 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:20.366489 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab2c6a-365a-412d-9f60-01e244ecc840 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:20.367539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab2c6a-365a-412d-9f60-01e244ecc840 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:20.367870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab2c6a-365a-412d-9f60-01e244ecc840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:20.391006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2eab2c6a-365a-412d-9f60-01e244ecc840 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:20.392156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2eab2c6a-365a-412d-9f60-01e244ecc840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:20.451891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 906/1824] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:20.461442 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:20.462839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:20.533001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0aa9a-cc32-46eb-a4b6-645b529c1df4 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:20.536767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2eb96-cdb4-43cc-a679-aace2dde5151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:20.537430 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2eb96-cdb4-43cc-a679-aace2dde5151 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:20.537760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2eb96-cdb4-43cc-a679-aace2dde5151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:20.538049 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2eb96-cdb4-43cc-a679-aace2dde5151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:20.550568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2eb96-cdb4-43cc-a679-aace2dde5151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:20.552255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2eb96-cdb4-43cc-a679-aace2dde5151 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:20.565229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 919/1825] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:21.285473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab2c6a-365a-412d-9f60-01e244ecc840 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:21.287481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2eab2c6a-365a-412d-9f60-01e244ecc840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:21.315344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab2c6a-365a-412d-9f60-01e244ecc840 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:21.321856 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:21.325898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:21.325898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:21.325898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] PATH_INFO: `/v3/projects/0b83aba17bd34f16b174d49a5bc25415` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:21.325898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b83aba17bd34f16b174d49a5bc25415)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:21.335633 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:21.471052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b83aba17bd34f16b174d49a5bc25415', 'request_id': 'req-d144af46-7529-4ce8-9870-f44368470841'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:21.478501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b83aba17bd34f16b174d49a5bc25415', 'request_id': 'req-d144af46-7529-4ce8-9870-f44368470841'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:21.518587 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2eb96-cdb4-43cc-a679-aace2dde5151 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:21.520507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-85c2eb96-cdb4-43cc-a679-aace2dde5151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:21.583183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2eb96-cdb4-43cc-a679-aace2dde5151 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:21.591505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b83aba17bd34f16b174d49a5bc25415', 'request_id': 'req-d144af46-7529-4ce8-9870-f44368470841'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:21.604709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] The token cache is being invalidate because project 0b83aba17bd34f16b174d49a5bc25415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:21.605249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:21.605945 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:21.607615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 907/1826] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:21 2022] DELETE /identity/v3/projects/0b83aba17bd34f16b174d49a5bc25415 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:21.612639 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:21.614270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:21.643893 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc889f7-0988-44a1-afad-db409b1ae505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:21.644574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc889f7-0988-44a1-afad-db409b1ae505 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:21.645342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc889f7-0988-44a1-afad-db409b1ae505 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:21.645342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc889f7-0988-44a1-afad-db409b1ae505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:21.647326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0dc889f7-0988-44a1-afad-db409b1ae505 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:21.691578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144af46-7529-4ce8-9870-f44368470841 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:21.697052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746dc4d-3037-4de3-bc73-776357aff9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:21.697999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746dc4d-3037-4de3-bc73-776357aff9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:21.698532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746dc4d-3037-4de3-bc73-776357aff9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:21.698809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746dc4d-3037-4de3-bc73-776357aff9c5 admin admin] PATH_INFO: `/v3/users/a71bf22300d94cbeaa99991f0fe06f92` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:21.700049 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746dc4d-3037-4de3-bc73-776357aff9c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71bf22300d94cbeaa99991f0fe06f92)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:21.702805 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746dc4d-3037-4de3-bc73-776357aff9c5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:21.726051 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc889f7-0988-44a1-afad-db409b1ae505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:21.728607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc889f7-0988-44a1-afad-db409b1ae505 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:21.753722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 920/1827] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:27:21.925865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7746dc4d-3037-4de3-bc73-776357aff9c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71bf22300d94cbeaa99991f0fe06f92'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:21.942544 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7746dc4d-3037-4de3-bc73-776357aff9c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71bf22300d94cbeaa99991f0fe06f92'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:21.950247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7746dc4d-3037-4de3-bc73-776357aff9c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71bf22300d94cbeaa99991f0fe06f92'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:21.950995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7746dc4d-3037-4de3-bc73-776357aff9c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71bf22300d94cbeaa99991f0fe06f92'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:22.117515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7746dc4d-3037-4de3-bc73-776357aff9c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71bf22300d94cbeaa99991f0fe06f92'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:22.125323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 908/1828] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:21 2022] DELETE /identity/v3/users/a71bf22300d94cbeaa99991f0fe06f92 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:22.593830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc889f7-0988-44a1-afad-db409b1ae505 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:22.613367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc889f7-0988-44a1-afad-db409b1ae505 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:22.678953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:22.680700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:22.681064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:22.681412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] PATH_INFO: `/v3/projects/5b0f0262ce9e45569142bc490c98693c` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:22.683279 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0f0262ce9e45569142bc490c98693c)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:22.685318 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:22.710783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff49553-0cce-4863-b659-3949275da851 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:22.712076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff49553-0cce-4863-b659-3949275da851 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:22.712588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff49553-0cce-4863-b659-3949275da851 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:22.714750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 909/1829] 10.222.0.64 () {54 vars in 921 bytes} [Fri May 13 17:27:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 17:27:22.724903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7bd35-d9d1-48cb-b49a-e9c926b222e0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:22.725187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7bd35-d9d1-48cb-b49a-e9c926b222e0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:22.725463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7bd35-d9d1-48cb-b49a-e9c926b222e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:22.746248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2ed7bd35-d9d1-48cb-b49a-e9c926b222e0 None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:22.747498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2ed7bd35-d9d1-48cb-b49a-e9c926b222e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:22.819750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 910/1830] 10.222.0.64 () {58 vars in 1018 bytes} [Fri May 13 17:27:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:22.835484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0f0262ce9e45569142bc490c98693c', 'request_id': 'req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:22.841381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0f0262ce9e45569142bc490c98693c', 'request_id': 'req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:22.861807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7bd35-d9d1-48cb-b49a-e9c926b222e0 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:22.863973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2ed7bd35-d9d1-48cb-b49a-e9c926b222e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:22.878765 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7bd35-d9d1-48cb-b49a-e9c926b222e0 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:22.928786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0f0262ce9e45569142bc490c98693c', 'request_id': 'req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:22.941289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] The token cache is being invalidate because project 5b0f0262ce9e45569142bc490c98693c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:22.941672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:22.942454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1ddae8de-4e12-4d7d-b59e-cd37bc96931c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:22.944698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 921/1831] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:22 2022] DELETE /identity/v3/projects/5b0f0262ce9e45569142bc490c98693c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:22.949402 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a16e3-52b4-4397-a892-7f6584a732a0 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:22.951234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a16e3-52b4-4397-a892-7f6584a732a0 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:22.951532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a16e3-52b4-4397-a892-7f6584a732a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:22.966805 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace4382-eff1-4c2c-8103-b76fa21d6654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:22.968347 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace4382-eff1-4c2c-8103-b76fa21d6654 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:22.968458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace4382-eff1-4c2c-8103-b76fa21d6654 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:22.968828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace4382-eff1-4c2c-8103-b76fa21d6654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:22.970873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9ace4382-eff1-4c2c-8103-b76fa21d6654 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:22.971365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-248a16e3-52b4-4397-a892-7f6584a732a0 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:22.972575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-248a16e3-52b4-4397-a892-7f6584a732a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:22.987672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace4382-eff1-4c2c-8103-b76fa21d6654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:22.991405 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace4382-eff1-4c2c-8103-b76fa21d6654 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:23.002645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 911/1832] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:27:23.051179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 922/1833] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:23.057760 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f3ef7-28b5-4319-a37a-0181ba2949dc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:23.058185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f3ef7-28b5-4319-a37a-0181ba2949dc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:23.058556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f3ef7-28b5-4319-a37a-0181ba2949dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:23.078109 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-250f3ef7-28b5-4319-a37a-0181ba2949dc None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:23.079794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-250f3ef7-28b5-4319-a37a-0181ba2949dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:23.088857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 912/1834] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:23.094692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a16e3-52b4-4397-a892-7f6584a732a0 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:23.104925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a16e3-52b4-4397-a892-7f6584a732a0 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:23.109830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c7aa4-2d29-41dc-99dd-8d3a2e6556b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:23.110565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c7aa4-2d29-41dc-99dd-8d3a2e6556b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:23.110916 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c7aa4-2d29-41dc-99dd-8d3a2e6556b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:23.111512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c7aa4-2d29-41dc-99dd-8d3a2e6556b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:23.112219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c7aa4-2d29-41dc-99dd-8d3a2e6556b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:23.112599 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c7aa4-2d29-41dc-99dd-8d3a2e6556b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:23.114288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c7aa4-2d29-41dc-99dd-8d3a2e6556b9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:23.126622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 923/1835] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:27:23.131423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f3ef7-28b5-4319-a37a-0181ba2949dc None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:23.143603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f3ef7-28b5-4319-a37a-0181ba2949dc None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:23.150825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a2b82-007a-46bf-af3b-0e37cc65bad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:23.151756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2b82-007a-46bf-af3b-0e37cc65bad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:23.152113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2b82-007a-46bf-af3b-0e37cc65bad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:23.152464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2b82-007a-46bf-af3b-0e37cc65bad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:23.153250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a2b82-007a-46bf-af3b-0e37cc65bad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:23.156534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a2b82-007a-46bf-af3b-0e37cc65bad7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:23.285372 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 913/1836] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:23 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:23.289288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c7aa4-2d29-41dc-99dd-8d3a2e6556b9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:23.300150 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c7aa4-2d29-41dc-99dd-8d3a2e6556b9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:23.361972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa714353-b64e-405c-ab50-e5cdfcb0a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:23.362683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa714353-b64e-405c-ab50-e5cdfcb0a3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:23.362972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa714353-b64e-405c-ab50-e5cdfcb0a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:23.363295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa714353-b64e-405c-ab50-e5cdfcb0a3b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:23.363986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa714353-b64e-405c-ab50-e5cdfcb0a3b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:23.365924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa714353-b64e-405c-ab50-e5cdfcb0a3b9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:23.444190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 924/1837] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:23 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:23.448425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a2b82-007a-46bf-af3b-0e37cc65bad7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:23.459394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a2b82-007a-46bf-af3b-0e37cc65bad7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:23.464226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1ef94-13f0-4b0c-98a7-7280f275df9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:23.464886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1ef94-13f0-4b0c-98a7-7280f275df9f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:23.465167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1ef94-13f0-4b0c-98a7-7280f275df9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:23.465444 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1ef94-13f0-4b0c-98a7-7280f275df9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:23.466167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1ef94-13f0-4b0c-98a7-7280f275df9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:23.468112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1ef94-13f0-4b0c-98a7-7280f275df9f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:23.479198 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 914/1838] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:23.482756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa714353-b64e-405c-ab50-e5cdfcb0a3b9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:23.492624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa714353-b64e-405c-ab50-e5cdfcb0a3b9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:23.497234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42476c92-5121-47bb-bf66-d81839feec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:23.497888 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42476c92-5121-47bb-bf66-d81839feec44 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:23.498174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42476c92-5121-47bb-bf66-d81839feec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:23.498454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42476c92-5121-47bb-bf66-d81839feec44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:23.499910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42476c92-5121-47bb-bf66-d81839feec44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:23.501507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42476c92-5121-47bb-bf66-d81839feec44 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:23.511085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 925/1839] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:23.515786 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1ef94-13f0-4b0c-98a7-7280f275df9f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:23.525313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1ef94-13f0-4b0c-98a7-7280f275df9f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:23.529894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b00adc-7732-4fb8-b2e3-5e28f095d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:23.530761 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00adc-7732-4fb8-b2e3-5e28f095d05c admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:23.531047 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00adc-7732-4fb8-b2e3-5e28f095d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:23.531447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00adc-7732-4fb8-b2e3-5e28f095d05c admin admin] PATH_INFO: `/v3/projects/135544e08d904014bcf3381862e7178f/users/6f16410a70c144beba1b99b34716a2ef/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:23.546937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b00adc-7732-4fb8-b2e3-5e28f095d05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=135544e08d904014bcf3381862e7178f, user_id=6f16410a70c144beba1b99b34716a2ef, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:23.549656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b00adc-7732-4fb8-b2e3-5e28f095d05c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:23.637553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 915/1840] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:23 2022] PUT /identity/v3/projects/135544e08d904014bcf3381862e7178f/users/6f16410a70c144beba1b99b34716a2ef/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:23.648602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba84ba-2f27-4b19-adc6-a0b01a88277f None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:23.649062 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba84ba-2f27-4b19-adc6-a0b01a88277f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:23.649344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba84ba-2f27-4b19-adc6-a0b01a88277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:23.692452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-92ba84ba-2f27-4b19-adc6-a0b01a88277f None None] MFA Rules not processed for user `6f16410a70c144beba1b99b34716a2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:23.693754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-92ba84ba-2f27-4b19-adc6-a0b01a88277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:23.794978 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 926/1841] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:23.799914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b00adc-7732-4fb8-b2e3-5e28f095d05c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:23.867833 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b00adc-7732-4fb8-b2e3-5e28f095d05c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:23.872850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b958f22-70b4-4324-a871-768a39bed4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:23.873520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958f22-70b4-4324-a871-768a39bed4cb admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:23.873861 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958f22-70b4-4324-a871-768a39bed4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:23.874646 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958f22-70b4-4324-a871-768a39bed4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:23.875404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b958f22-70b4-4324-a871-768a39bed4cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:23.877463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b958f22-70b4-4324-a871-768a39bed4cb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:23.952340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 916/1842] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:23 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:23.952509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba84ba-2f27-4b19-adc6-a0b01a88277f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:23.962049 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba84ba-2f27-4b19-adc6-a0b01a88277f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:24.020815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c98278-79bd-459c-8d81-7bb261f4f99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:24.021500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c98278-79bd-459c-8d81-7bb261f4f99f admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:24.021788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c98278-79bd-459c-8d81-7bb261f4f99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:24.022069 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c98278-79bd-459c-8d81-7bb261f4f99f admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:24.022774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c98278-79bd-459c-8d81-7bb261f4f99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:24.024757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c98278-79bd-459c-8d81-7bb261f4f99f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:24.095783 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 927/1843] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:23 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:24.099663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b958f22-70b4-4324-a871-768a39bed4cb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:24.110657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b958f22-70b4-4324-a871-768a39bed4cb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:24.115822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05450bfc-4d8d-4fd7-9bad-4f7c43ba2b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:24.116484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450bfc-4d8d-4fd7-9bad-4f7c43ba2b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:24.116769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450bfc-4d8d-4fd7-9bad-4f7c43ba2b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:24.117048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450bfc-4d8d-4fd7-9bad-4f7c43ba2b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:24.117772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05450bfc-4d8d-4fd7-9bad-4f7c43ba2b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:24.119416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05450bfc-4d8d-4fd7-9bad-4f7c43ba2b70 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:24.130012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 917/1844] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:24.134177 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c98278-79bd-459c-8d81-7bb261f4f99f admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:24.143886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c98278-79bd-459c-8d81-7bb261f4f99f admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:24.148424 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e2370-89d8-4804-8669-747a5fa58d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:24.149284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e2370-89d8-4804-8669-747a5fa58d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:24.149560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e2370-89d8-4804-8669-747a5fa58d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:24.149829 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e2370-89d8-4804-8669-747a5fa58d47 admin admin] PATH_INFO: `/v3/projects/1fac2d7c30544479937f5814ffe7d83f/users/2721db6aa8c842be818ea7106d99e4ac/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:24.164652 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e2370-89d8-4804-8669-747a5fa58d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fac2d7c30544479937f5814ffe7d83f, user_id=2721db6aa8c842be818ea7106d99e4ac, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:24.167333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e2370-89d8-4804-8669-747a5fa58d47 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:24.247543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 928/1845] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:24 2022] PUT /identity/v3/projects/1fac2d7c30544479937f5814ffe7d83f/users/2721db6aa8c842be818ea7106d99e4ac/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:24.251393 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05450bfc-4d8d-4fd7-9bad-4f7c43ba2b70 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:24.261183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05450bfc-4d8d-4fd7-9bad-4f7c43ba2b70 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:24.316969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50eb95-932f-4b96-8634-9c515392d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:24.317642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50eb95-932f-4b96-8634-9c515392d44c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:24.317923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50eb95-932f-4b96-8634-9c515392d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:24.318201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50eb95-932f-4b96-8634-9c515392d44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:24.318928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50eb95-932f-4b96-8634-9c515392d44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:24.320576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50eb95-932f-4b96-8634-9c515392d44c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:24.330182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 918/1846] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:24.334284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e2370-89d8-4804-8669-747a5fa58d47 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:24.345796 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e2370-89d8-4804-8669-747a5fa58d47 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:24.350635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f90d8c-b168-4a29-a2ad-99ede7487a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:24.353168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f90d8c-b168-4a29-a2ad-99ede7487a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:24.353467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f90d8c-b168-4a29-a2ad-99ede7487a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:24.353751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f90d8c-b168-4a29-a2ad-99ede7487a68 admin admin] PATH_INFO: `/v3/projects/1fac2d7c30544479937f5814ffe7d83f/users/2721db6aa8c842be818ea7106d99e4ac/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:24.355867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f90d8c-b168-4a29-a2ad-99ede7487a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fac2d7c30544479937f5814ffe7d83f, user_id=2721db6aa8c842be818ea7106d99e4ac, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:24.359172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f90d8c-b168-4a29-a2ad-99ede7487a68 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:24.370417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 929/1847] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:24 2022] PUT /identity/v3/projects/1fac2d7c30544479937f5814ffe7d83f/users/2721db6aa8c842be818ea7106d99e4ac/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:24.381576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8be3-7403-4154-b61b-490fdbb2285d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:24.381870 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8be3-7403-4154-b61b-490fdbb2285d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:24.382152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8be3-7403-4154-b61b-490fdbb2285d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:24.411705 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-addf8be3-7403-4154-b61b-490fdbb2285d None None] MFA Rules not processed for user `2721db6aa8c842be818ea7106d99e4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:24.412960 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-addf8be3-7403-4154-b61b-490fdbb2285d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:24.481079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 919/1848] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:24.492382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f90d8c-b168-4a29-a2ad-99ede7487a68 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:24.494187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-73f90d8c-b168-4a29-a2ad-99ede7487a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:24.550602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f90d8c-b168-4a29-a2ad-99ede7487a68 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:24.554298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72500ce8-62b7-4910-af1e-f245ac02c778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:24.554941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72500ce8-62b7-4910-af1e-f245ac02c778 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:24.555258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72500ce8-62b7-4910-af1e-f245ac02c778 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:24.555540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72500ce8-62b7-4910-af1e-f245ac02c778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:24.564238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72500ce8-62b7-4910-af1e-f245ac02c778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:24.565680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72500ce8-62b7-4910-af1e-f245ac02c778 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:24.574794 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 930/1849] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:24.698616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8be3-7403-4154-b61b-490fdbb2285d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:24.707982 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8be3-7403-4154-b61b-490fdbb2285d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:24.711879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9af54-81d8-4fd4-8b8e-2da3489f5aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:24.712529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9af54-81d8-4fd4-8b8e-2da3489f5aec service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:24.712812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9af54-81d8-4fd4-8b8e-2da3489f5aec service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:24.713088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9af54-81d8-4fd4-8b8e-2da3489f5aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:24.768670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9af54-81d8-4fd4-8b8e-2da3489f5aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:24.770131 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9af54-81d8-4fd4-8b8e-2da3489f5aec service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:24.779293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 920/1850] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:29.753145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72500ce8-62b7-4910-af1e-f245ac02c778 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:29.815302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72500ce8-62b7-4910-af1e-f245ac02c778 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:29.819964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:29.820901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:29.821186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:29.821482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] PATH_INFO: `/v3/users/6f16410a70c144beba1b99b34716a2ef` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:29.825146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f16410a70c144beba1b99b34716a2ef)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:29.825146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:30.079639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f16410a70c144beba1b99b34716a2ef'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:30.090897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f16410a70c144beba1b99b34716a2ef'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:30.091596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f16410a70c144beba1b99b34716a2ef'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:30.202794 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f16410a70c144beba1b99b34716a2ef'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:30.210879 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f16410a70c144beba1b99b34716a2ef'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:30.216715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 931/1851] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:29 2022] DELETE /identity/v3/users/6f16410a70c144beba1b99b34716a2ef => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:30.222406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36224-75d5-4100-9233-00a2a71716b6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:30.222907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36224-75d5-4100-9233-00a2a71716b6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:30.223081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36224-75d5-4100-9233-00a2a71716b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:30.242770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0fd36224-75d5-4100-9233-00a2a71716b6 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:30.244096 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0fd36224-75d5-4100-9233-00a2a71716b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:30.319361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 921/1852] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:30.332583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:30.334000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:30.396629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0531f-5c1c-470e-a8d0-0b6133958658 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:30.400397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72527e-b98f-4a14-a962-a1a250add111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:30.401044 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72527e-b98f-4a14-a962-a1a250add111 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:30.401321 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72527e-b98f-4a14-a962-a1a250add111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:30.401589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72527e-b98f-4a14-a962-a1a250add111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:30.411274 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72527e-b98f-4a14-a962-a1a250add111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:30.412718 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72527e-b98f-4a14-a962-a1a250add111 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:30.422396 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 932/1853] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:30.833545 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd36224-75d5-4100-9233-00a2a71716b6 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:30.835017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0fd36224-75d5-4100-9233-00a2a71716b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:30.850302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd36224-75d5-4100-9233-00a2a71716b6 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:30.855032 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:30.856460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:30.856752 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:30.857539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] PATH_INFO: `/v3/projects/135544e08d904014bcf3381862e7178f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:30.858348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=135544e08d904014bcf3381862e7178f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:30.862507 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:31.031146 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135544e08d904014bcf3381862e7178f', 'request_id': 'req-91d80377-6f9c-4cb2-a246-21f7d135dcaa'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:31.037404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135544e08d904014bcf3381862e7178f', 'request_id': 'req-91d80377-6f9c-4cb2-a246-21f7d135dcaa'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:31.105519 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135544e08d904014bcf3381862e7178f', 'request_id': 'req-91d80377-6f9c-4cb2-a246-21f7d135dcaa'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:31.117490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] The token cache is being invalidate because project 135544e08d904014bcf3381862e7178f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:31.117776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:31.118401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:31.119978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 922/1854] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:30 2022] DELETE /identity/v3/projects/135544e08d904014bcf3381862e7178f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:31.123839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72527e-b98f-4a14-a962-a1a250add111 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:31.133178 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72527e-b98f-4a14-a962-a1a250add111 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:31.186264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946db3f-6c68-495e-a6ad-f2a02ff7c86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:31.187145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946db3f-6c68-495e-a6ad-f2a02ff7c86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:31.187446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946db3f-6c68-495e-a6ad-f2a02ff7c86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:31.187831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946db3f-6c68-495e-a6ad-f2a02ff7c86f admin admin] PATH_INFO: `/v3/users/2721db6aa8c842be818ea7106d99e4ac` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:31.189022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946db3f-6c68-495e-a6ad-f2a02ff7c86f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2721db6aa8c842be818ea7106d99e4ac)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:31.190962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946db3f-6c68-495e-a6ad-f2a02ff7c86f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:31.369618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4946db3f-6c68-495e-a6ad-f2a02ff7c86f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2721db6aa8c842be818ea7106d99e4ac'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:31.382027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4946db3f-6c68-495e-a6ad-f2a02ff7c86f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2721db6aa8c842be818ea7106d99e4ac'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:31.382807 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4946db3f-6c68-495e-a6ad-f2a02ff7c86f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2721db6aa8c842be818ea7106d99e4ac'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:31.477438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4946db3f-6c68-495e-a6ad-f2a02ff7c86f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2721db6aa8c842be818ea7106d99e4ac'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:31.486589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4946db3f-6c68-495e-a6ad-f2a02ff7c86f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2721db6aa8c842be818ea7106d99e4ac'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:31.493941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 933/1855] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:31 2022] DELETE /identity/v3/users/2721db6aa8c842be818ea7106d99e4ac => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:31.891389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:31.895053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:31.910866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d80377-6f9c-4cb2-a246-21f7d135dcaa admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:31.971922 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:31.972824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:31.973105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:31.973377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] PATH_INFO: `/v3/projects/1fac2d7c30544479937f5814ffe7d83f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:31.974565 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fac2d7c30544479937f5814ffe7d83f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:31.976522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:32.142030 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fac2d7c30544479937f5814ffe7d83f', 'request_id': 'req-d0bbc782-4ebf-4d5e-b709-655d067f1862'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:32.148958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fac2d7c30544479937f5814ffe7d83f', 'request_id': 'req-d0bbc782-4ebf-4d5e-b709-655d067f1862'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:32.248235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fac2d7c30544479937f5814ffe7d83f', 'request_id': 'req-d0bbc782-4ebf-4d5e-b709-655d067f1862'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:32.261360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] The token cache is being invalidate because project 1fac2d7c30544479937f5814ffe7d83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:32.261360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:32.261876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d0bbc782-4ebf-4d5e-b709-655d067f1862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:32.263684 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 923/1856] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:31 2022] DELETE /identity/v3/projects/1fac2d7c30544479937f5814ffe7d83f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:32.269130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3ce1c-8e9b-4e71-b4b1-94199a96c348 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:32.269605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3ce1c-8e9b-4e71-b4b1-94199a96c348 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:32.269777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3ce1c-8e9b-4e71-b4b1-94199a96c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:32.290232 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a2f3ce1c-8e9b-4e71-b4b1-94199a96c348 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:32.291671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a2f3ce1c-8e9b-4e71-b4b1-94199a96c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:32.354158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 934/1857] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:32.362544 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0cfe1-e5ee-4009-828c-cbad89252985 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:32.362837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0cfe1-e5ee-4009-828c-cbad89252985 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:32.363115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0cfe1-e5ee-4009-828c-cbad89252985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:32.381876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e1e0cfe1-e5ee-4009-828c-cbad89252985 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:32.383091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e1e0cfe1-e5ee-4009-828c-cbad89252985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:32.391180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 924/1858] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:32.395512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3ce1c-8e9b-4e71-b4b1-94199a96c348 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:32.404760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3ce1c-8e9b-4e71-b4b1-94199a96c348 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:32.411414 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23756871-a1e4-4663-9974-17ae164db24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:32.412067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756871-a1e4-4663-9974-17ae164db24f admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:32.412354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756871-a1e4-4663-9974-17ae164db24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:32.412631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23756871-a1e4-4663-9974-17ae164db24f admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:32.413384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23756871-a1e4-4663-9974-17ae164db24f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:32.413688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23756871-a1e4-4663-9974-17ae164db24f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:32.415334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23756871-a1e4-4663-9974-17ae164db24f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:32.428370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 935/1859] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:27:32.433795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0cfe1-e5ee-4009-828c-cbad89252985 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:32.443483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0cfe1-e5ee-4009-828c-cbad89252985 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:32.448239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f7414-95d8-4d25-8811-00024f3b193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:32.448898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7414-95d8-4d25-8811-00024f3b193a admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:32.449177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7414-95d8-4d25-8811-00024f3b193a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:32.450114 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7414-95d8-4d25-8811-00024f3b193a admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:32.450209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f7414-95d8-4d25-8811-00024f3b193a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:32.452188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f7414-95d8-4d25-8811-00024f3b193a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:32.595559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 925/1860] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:32 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:32.599911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23756871-a1e4-4663-9974-17ae164db24f admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:32.610534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23756871-a1e4-4663-9974-17ae164db24f admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:32.676130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eab4a-15d4-4e75-80aa-a6b1eb7bcac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:32.677345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eab4a-15d4-4e75-80aa-a6b1eb7bcac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:32.677863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eab4a-15d4-4e75-80aa-a6b1eb7bcac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:32.678349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eab4a-15d4-4e75-80aa-a6b1eb7bcac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:32.679362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5eab4a-15d4-4e75-80aa-a6b1eb7bcac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:32.681899 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5eab4a-15d4-4e75-80aa-a6b1eb7bcac9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:32.760937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 936/1861] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:32 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:32.765027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f7414-95d8-4d25-8811-00024f3b193a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:32.777480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f7414-95d8-4d25-8811-00024f3b193a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:32.783681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4b8b9-6193-4805-b5da-c0bfccd13342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:32.784661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b8b9-6193-4805-b5da-c0bfccd13342 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:32.784951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b8b9-6193-4805-b5da-c0bfccd13342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:32.785614 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b8b9-6193-4805-b5da-c0bfccd13342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:32.785959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4b8b9-6193-4805-b5da-c0bfccd13342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:32.787770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4b8b9-6193-4805-b5da-c0bfccd13342 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:32.811214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 926/1862] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:32.812683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eab4a-15d4-4e75-80aa-a6b1eb7bcac9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:32.824271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eab4a-15d4-4e75-80aa-a6b1eb7bcac9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:32.831768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2936c-2418-4a2f-aa37-3d2a6439aa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:32.832446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2936c-2418-4a2f-aa37-3d2a6439aa60 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:32.832737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2936c-2418-4a2f-aa37-3d2a6439aa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:32.833016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2936c-2418-4a2f-aa37-3d2a6439aa60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:32.833750 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2936c-2418-4a2f-aa37-3d2a6439aa60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:32.835406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2936c-2418-4a2f-aa37-3d2a6439aa60 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:32.846404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 937/1863] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:32.850597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4b8b9-6193-4805-b5da-c0bfccd13342 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:32.860661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4b8b9-6193-4805-b5da-c0bfccd13342 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:32.865556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1991ee3-b901-47ff-a97c-5f07b315a584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:32.866441 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1991ee3-b901-47ff-a97c-5f07b315a584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:32.866725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1991ee3-b901-47ff-a97c-5f07b315a584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:32.867004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1991ee3-b901-47ff-a97c-5f07b315a584 admin admin] PATH_INFO: `/v3/projects/f3f4b13789c64a0b8e7ca4007ebc6774/users/5f8725b99afd46dc981d42a04a54f3df/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:32.882690 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1991ee3-b901-47ff-a97c-5f07b315a584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f4b13789c64a0b8e7ca4007ebc6774, user_id=5f8725b99afd46dc981d42a04a54f3df, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:32.885593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1991ee3-b901-47ff-a97c-5f07b315a584 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:33.003694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 927/1864] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:32 2022] PUT /identity/v3/projects/f3f4b13789c64a0b8e7ca4007ebc6774/users/5f8725b99afd46dc981d42a04a54f3df/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:33.014056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a6392-4841-4543-a7ad-bb7c61c230b7 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:33.014345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a6392-4841-4543-a7ad-bb7c61c230b7 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:33.014620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a6392-4841-4543-a7ad-bb7c61c230b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:33.040829 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-9b0a6392-4841-4543-a7ad-bb7c61c230b7 None None] MFA Rules not processed for user `5f8725b99afd46dc981d42a04a54f3df`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:33.042020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-9b0a6392-4841-4543-a7ad-bb7c61c230b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:33.109086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 938/1865] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:33.113611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1991ee3-b901-47ff-a97c-5f07b315a584 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:33.174243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1991ee3-b901-47ff-a97c-5f07b315a584 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:33.178965 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0bf4b-9bd2-42ac-acb7-a339d536e49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:33.179659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0bf4b-9bd2-42ac-acb7-a339d536e49e admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:33.179949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0bf4b-9bd2-42ac-acb7-a339d536e49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:33.180233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0bf4b-9bd2-42ac-acb7-a339d536e49e admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:33.180990 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0bf4b-9bd2-42ac-acb7-a339d536e49e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:33.182938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0bf4b-9bd2-42ac-acb7-a339d536e49e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:33.295468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 928/1866] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:33 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:33.299656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a6392-4841-4543-a7ad-bb7c61c230b7 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:33.310494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a6392-4841-4543-a7ad-bb7c61c230b7 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:33.381072 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6e0ac-d9fd-4d51-961c-48275449266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:33.387067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e0ac-d9fd-4d51-961c-48275449266e admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:33.387067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e0ac-d9fd-4d51-961c-48275449266e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:33.387067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e0ac-d9fd-4d51-961c-48275449266e admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:33.387067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6e0ac-d9fd-4d51-961c-48275449266e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:33.387067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6e0ac-d9fd-4d51-961c-48275449266e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:33.479986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 939/1867] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:33 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:33.481073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0bf4b-9bd2-42ac-acb7-a339d536e49e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:33.491992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0bf4b-9bd2-42ac-acb7-a339d536e49e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:33.496632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7474b-f61c-4fcc-b468-0ac0afec636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:33.497339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7474b-f61c-4fcc-b468-0ac0afec636c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:33.497547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7474b-f61c-4fcc-b468-0ac0afec636c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:33.497816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7474b-f61c-4fcc-b468-0ac0afec636c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:33.498570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7474b-f61c-4fcc-b468-0ac0afec636c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:33.500303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7474b-f61c-4fcc-b468-0ac0afec636c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:33.511505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 929/1868] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:33.518980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6e0ac-d9fd-4d51-961c-48275449266e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:33.527384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6e0ac-d9fd-4d51-961c-48275449266e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:33.532233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cfaea-904f-4fbe-973c-09f34c072f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:33.533108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cfaea-904f-4fbe-973c-09f34c072f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:33.533390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cfaea-904f-4fbe-973c-09f34c072f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:33.543801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cfaea-904f-4fbe-973c-09f34c072f51 admin admin] PATH_INFO: `/v3/projects/4210319403be43d5a3df278a7c710a01/users/ecdb3d6c99db4301b5fc85d485fe4529/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:33.556589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cfaea-904f-4fbe-973c-09f34c072f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4210319403be43d5a3df278a7c710a01, user_id=ecdb3d6c99db4301b5fc85d485fe4529, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:33.559302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cfaea-904f-4fbe-973c-09f34c072f51 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:33.643161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 940/1869] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:33 2022] PUT /identity/v3/projects/4210319403be43d5a3df278a7c710a01/users/ecdb3d6c99db4301b5fc85d485fe4529/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:33.646930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7474b-f61c-4fcc-b468-0ac0afec636c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:33.656946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7474b-f61c-4fcc-b468-0ac0afec636c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:33.712475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882f6fd-4da6-481f-be85-ef6a2f91a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:33.713152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f6fd-4da6-481f-be85-ef6a2f91a39f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:33.713439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f6fd-4da6-481f-be85-ef6a2f91a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:33.713717 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f6fd-4da6-481f-be85-ef6a2f91a39f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:33.714442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882f6fd-4da6-481f-be85-ef6a2f91a39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:33.716153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882f6fd-4da6-481f-be85-ef6a2f91a39f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:33.731346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 930/1870] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:33.737077 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cfaea-904f-4fbe-973c-09f34c072f51 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:33.747866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cfaea-904f-4fbe-973c-09f34c072f51 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:33.753556 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b47a9e-425e-4b36-865b-0ec1b086a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:33.754447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b47a9e-425e-4b36-865b-0ec1b086a72f admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:33.754726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b47a9e-425e-4b36-865b-0ec1b086a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:33.755085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b47a9e-425e-4b36-865b-0ec1b086a72f admin admin] PATH_INFO: `/v3/projects/4210319403be43d5a3df278a7c710a01/users/ecdb3d6c99db4301b5fc85d485fe4529/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:33.757122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b47a9e-425e-4b36-865b-0ec1b086a72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4210319403be43d5a3df278a7c710a01, user_id=ecdb3d6c99db4301b5fc85d485fe4529, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:33.759818 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b47a9e-425e-4b36-865b-0ec1b086a72f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:33.771228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 941/1871] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:33 2022] PUT /identity/v3/projects/4210319403be43d5a3df278a7c710a01/users/ecdb3d6c99db4301b5fc85d485fe4529/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:33.791666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91414-87f3-4bdd-b6d8-ad63a0bf9fda None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:33.792003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91414-87f3-4bdd-b6d8-ad63a0bf9fda None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:33.792266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91414-87f3-4bdd-b6d8-ad63a0bf9fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:33.821877 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f2b91414-87f3-4bdd-b6d8-ad63a0bf9fda None None] MFA Rules not processed for user `ecdb3d6c99db4301b5fc85d485fe4529`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:33.823108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f2b91414-87f3-4bdd-b6d8-ad63a0bf9fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:33.909106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 931/1872] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:33.922080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b47a9e-425e-4b36-865b-0ec1b086a72f admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:33.924711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f2b47a9e-425e-4b36-865b-0ec1b086a72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:34.016867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b47a9e-425e-4b36-865b-0ec1b086a72f admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:34.021034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b48a60-92be-4766-a36f-8f8ff989fd92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:34.021768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b48a60-92be-4766-a36f-8f8ff989fd92 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:34.022231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b48a60-92be-4766-a36f-8f8ff989fd92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:34.022811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b48a60-92be-4766-a36f-8f8ff989fd92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:34.039092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b48a60-92be-4766-a36f-8f8ff989fd92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:34.040827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b48a60-92be-4766-a36f-8f8ff989fd92 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:34.051761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 942/1873] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:27:34.148652 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b91414-87f3-4bdd-b6d8-ad63a0bf9fda None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:34.158000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b91414-87f3-4bdd-b6d8-ad63a0bf9fda None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:34.161718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244f33d-3d1c-4286-918a-a6efbee565b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:34.162354 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f33d-3d1c-4286-918a-a6efbee565b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:34.162636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f33d-3d1c-4286-918a-a6efbee565b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:34.162911 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f33d-3d1c-4286-918a-a6efbee565b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:34.221904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244f33d-3d1c-4286-918a-a6efbee565b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:34.224149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244f33d-3d1c-4286-918a-a6efbee565b8 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:34.233185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 932/1874] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:41.560004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b48a60-92be-4766-a36f-8f8ff989fd92 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:41.651283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b48a60-92be-4766-a36f-8f8ff989fd92 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:41.656381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:41.658540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:41.658933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:41.659349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] PATH_INFO: `/v3/users/5f8725b99afd46dc981d42a04a54f3df` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:41.660697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f8725b99afd46dc981d42a04a54f3df)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:41.662738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:41.868140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f8725b99afd46dc981d42a04a54f3df'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:41.880334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f8725b99afd46dc981d42a04a54f3df'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:41.881295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f8725b99afd46dc981d42a04a54f3df'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:41.985292 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f8725b99afd46dc981d42a04a54f3df'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:41.992815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f8725b99afd46dc981d42a04a54f3df'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:41.998918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 943/1875] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:41 2022] DELETE /identity/v3/users/5f8725b99afd46dc981d42a04a54f3df => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:42.003992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c160090-ce6a-44a7-84e9-268fba6182f0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:42.004435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c160090-ce6a-44a7-84e9-268fba6182f0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:42.004551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c160090-ce6a-44a7-84e9-268fba6182f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:42.021766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0c160090-ce6a-44a7-84e9-268fba6182f0 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:42.023051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0c160090-ce6a-44a7-84e9-268fba6182f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:42.087862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 933/1876] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:42.105088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:42.107223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:42.186763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfea0cb-be60-413f-9307-10f94f839592 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:42.191381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67ac75-9cdc-44f1-bfa7-5bcfcb2b1c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:42.192138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67ac75-9cdc-44f1-bfa7-5bcfcb2b1c0c service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:42.192426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67ac75-9cdc-44f1-bfa7-5bcfcb2b1c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:42.192705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67ac75-9cdc-44f1-bfa7-5bcfcb2b1c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:42.202179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67ac75-9cdc-44f1-bfa7-5bcfcb2b1c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:42.203830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67ac75-9cdc-44f1-bfa7-5bcfcb2b1c0c service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:42.213964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 944/1877] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:42.700297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c160090-ce6a-44a7-84e9-268fba6182f0 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:42.701857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0c160090-ce6a-44a7-84e9-268fba6182f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:42.714397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c160090-ce6a-44a7-84e9-268fba6182f0 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:42.742732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:42.742732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:42.742732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:42.742732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] PATH_INFO: `/v3/projects/f3f4b13789c64a0b8e7ca4007ebc6774` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:42.743559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f4b13789c64a0b8e7ca4007ebc6774)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:42.745571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:42.895248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f4b13789c64a0b8e7ca4007ebc6774', 'request_id': 'req-dc3965f6-176e-4644-a005-5a837dda84d6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:42.900599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f4b13789c64a0b8e7ca4007ebc6774', 'request_id': 'req-dc3965f6-176e-4644-a005-5a837dda84d6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:42.985130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f4b13789c64a0b8e7ca4007ebc6774', 'request_id': 'req-dc3965f6-176e-4644-a005-5a837dda84d6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:43.002252 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] The token cache is being invalidate because project f3f4b13789c64a0b8e7ca4007ebc6774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:43.002761 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:43.003741 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:43.005378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 934/1878] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:42 2022] DELETE /identity/v3/projects/f3f4b13789c64a0b8e7ca4007ebc6774 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:43.009324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67ac75-9cdc-44f1-bfa7-5bcfcb2b1c0c service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:43.019023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67ac75-9cdc-44f1-bfa7-5bcfcb2b1c0c service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:43.077232 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:43.078135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:43.078415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:43.078685 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] PATH_INFO: `/v3/users/ecdb3d6c99db4301b5fc85d485fe4529` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:43.079890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecdb3d6c99db4301b5fc85d485fe4529)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:43.082364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:43.643661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecdb3d6c99db4301b5fc85d485fe4529'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:43.659108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecdb3d6c99db4301b5fc85d485fe4529'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:43.660030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecdb3d6c99db4301b5fc85d485fe4529'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:43.733979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecdb3d6c99db4301b5fc85d485fe4529'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:43.743338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecdb3d6c99db4301b5fc85d485fe4529'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:43.746897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 945/1879] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:43 2022] DELETE /identity/v3/users/ecdb3d6c99db4301b5fc85d485fe4529 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:44.289218 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:44.290656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:44.302035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:44.303689 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:44.307872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3965f6-176e-4644-a005-5a837dda84d6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:44.376302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51787df2-2d4c-4e48-947d-fcc1d190e148 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:44.381831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:44.382777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:44.383152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:44.383446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] PATH_INFO: `/v3/projects/4210319403be43d5a3df278a7c710a01` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:44.384709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4210319403be43d5a3df278a7c710a01)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:44.386610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:44.395352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3406d-848e-4593-9931-d2f57c40fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:44.396451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3406d-848e-4593-9931-d2f57c40fe3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:44.396738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3406d-848e-4593-9931-d2f57c40fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:44.397007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3406d-848e-4593-9931-d2f57c40fe3d admin admin] PATH_INFO: `/v3/users/0fde5541fc92404fbdb325edd923039a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:44.398339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3406d-848e-4593-9931-d2f57c40fe3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fde5541fc92404fbdb325edd923039a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:44.400361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3406d-848e-4593-9931-d2f57c40fe3d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:44.499936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4210319403be43d5a3df278a7c710a01', 'request_id': 'req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:44.505164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4210319403be43d5a3df278a7c710a01', 'request_id': 'req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:44.573752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4210319403be43d5a3df278a7c710a01', 'request_id': 'req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:44.586480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] The token cache is being invalidate because project 4210319403be43d5a3df278a7c710a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:44.586823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:44.587487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-214e11e8-dbef-4c0a-b5e3-01e42e0a9285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:44.589047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 946/1880] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:44 2022] DELETE /identity/v3/projects/4210319403be43d5a3df278a7c710a01 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:44.594166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6271b7-2da0-4338-ab88-24ada7a68f89 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:44.594399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6271b7-2da0-4338-ab88-24ada7a68f89 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:44.594683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6271b7-2da0-4338-ab88-24ada7a68f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:44.611633 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7cd3406d-848e-4593-9931-d2f57c40fe3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fde5541fc92404fbdb325edd923039a'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:44.612869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-9c6271b7-2da0-4338-ab88-24ada7a68f89 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:44.614081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-9c6271b7-2da0-4338-ab88-24ada7a68f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:44.623925 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7cd3406d-848e-4593-9931-d2f57c40fe3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fde5541fc92404fbdb325edd923039a'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:44.630857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7cd3406d-848e-4593-9931-d2f57c40fe3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fde5541fc92404fbdb325edd923039a'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:44.631610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7cd3406d-848e-4593-9931-d2f57c40fe3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fde5541fc92404fbdb325edd923039a'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:44.671628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 947/1881] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:44.679356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae551b56-34bf-48f2-a3ae-4a759993a2a1 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:44.679653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae551b56-34bf-48f2-a3ae-4a759993a2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:44.679964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae551b56-34bf-48f2-a3ae-4a759993a2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:44.696927 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-ae551b56-34bf-48f2-a3ae-4a759993a2a1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:44.698147 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ae551b56-34bf-48f2-a3ae-4a759993a2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:44.706616 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 948/1882] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:44.710692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae551b56-34bf-48f2-a3ae-4a759993a2a1 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:44.720045 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae551b56-34bf-48f2-a3ae-4a759993a2a1 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:44.725387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7026f9a-6154-4d23-a9c1-5413df6fc507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:44.726044 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7026f9a-6154-4d23-a9c1-5413df6fc507 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:44.726462 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7026f9a-6154-4d23-a9c1-5413df6fc507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:44.726940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7026f9a-6154-4d23-a9c1-5413df6fc507 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:44.727707 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7026f9a-6154-4d23-a9c1-5413df6fc507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:44.728017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7026f9a-6154-4d23-a9c1-5413df6fc507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:44.728482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7cd3406d-848e-4593-9931-d2f57c40fe3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fde5541fc92404fbdb325edd923039a'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:44.729633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7026f9a-6154-4d23-a9c1-5413df6fc507 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:44.738253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 935/1883] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:44 2022] DELETE /identity/v3/users/0fde5541fc92404fbdb325edd923039a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:44.739806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeed0c-b285-401b-aea0-f1895c3d2f64 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:44.739996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeed0c-b285-401b-aea0-f1895c3d2f64 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:44.740276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeed0c-b285-401b-aea0-f1895c3d2f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:44.743081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 949/1884] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:27:44.747025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7026f9a-6154-4d23-a9c1-5413df6fc507 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:44.749208 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b7026f9a-6154-4d23-a9c1-5413df6fc507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:44.761317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e9aeed0c-b285-401b-aea0-f1895c3d2f64 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:44.762520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e9aeed0c-b285-401b-aea0-f1895c3d2f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:44.762732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7026f9a-6154-4d23-a9c1-5413df6fc507 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:44.821078 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c76705-165c-42b9-a4bc-3a7eefa15ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:44.821760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c76705-165c-42b9-a4bc-3a7eefa15ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:44.822048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c76705-165c-42b9-a4bc-3a7eefa15ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:44.822325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c76705-165c-42b9-a4bc-3a7eefa15ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:44.823076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c76705-165c-42b9-a4bc-3a7eefa15ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:44.825036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c76705-165c-42b9-a4bc-3a7eefa15ce9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:44.828964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 936/1885] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:44.838740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aeed0c-b285-401b-aea0-f1895c3d2f64 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:44.842534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e9aeed0c-b285-401b-aea0-f1895c3d2f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:44.909674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aeed0c-b285-401b-aea0-f1895c3d2f64 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:44.913188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bda551-bdc4-42a7-be70-0e6abbbc6859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:44.913822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bda551-bdc4-42a7-be70-0e6abbbc6859 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:44.914099 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bda551-bdc4-42a7-be70-0e6abbbc6859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:44.914370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bda551-bdc4-42a7-be70-0e6abbbc6859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:44.923873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 950/1886] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:44 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:44.924197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bda551-bdc4-42a7-be70-0e6abbbc6859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:44.925658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bda551-bdc4-42a7-be70-0e6abbbc6859 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:44.928154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c76705-165c-42b9-a4bc-3a7eefa15ce9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:44.935293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 937/1887] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:27:44.995040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c76705-165c-42b9-a4bc-3a7eefa15ce9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:44.999877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196dc59-94a8-4774-a57f-5a52b0a2e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:45.000552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196dc59-94a8-4774-a57f-5a52b0a2e985 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:45.000839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196dc59-94a8-4774-a57f-5a52b0a2e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:45.001153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196dc59-94a8-4774-a57f-5a52b0a2e985 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:45.002417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196dc59-94a8-4774-a57f-5a52b0a2e985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:45.007405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196dc59-94a8-4774-a57f-5a52b0a2e985 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:45.100786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 951/1888] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:44 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:45.105068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bda551-bdc4-42a7-be70-0e6abbbc6859 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:45.114744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bda551-bdc4-42a7-be70-0e6abbbc6859 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:45.119477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd5be4-9751-4421-8ada-22e17040985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:45.120124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5be4-9751-4421-8ada-22e17040985b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:45.120403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5be4-9751-4421-8ada-22e17040985b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:45.120674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5be4-9751-4421-8ada-22e17040985b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:45.121540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd5be4-9751-4421-8ada-22e17040985b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:45.123162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd5be4-9751-4421-8ada-22e17040985b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:45.135501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 938/1889] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:45.138983 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196dc59-94a8-4774-a57f-5a52b0a2e985 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:45.149959 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196dc59-94a8-4774-a57f-5a52b0a2e985 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:45.156290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c90069-cd65-4f43-bb0b-4e93ea2cc12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:45.156967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c90069-cd65-4f43-bb0b-4e93ea2cc12e admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:45.157254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c90069-cd65-4f43-bb0b-4e93ea2cc12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:45.157627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c90069-cd65-4f43-bb0b-4e93ea2cc12e admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:45.158329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c90069-cd65-4f43-bb0b-4e93ea2cc12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:45.160105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c90069-cd65-4f43-bb0b-4e93ea2cc12e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:45.174456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 952/1890] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:45.176069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd5be4-9751-4421-8ada-22e17040985b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:45.191830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd5be4-9751-4421-8ada-22e17040985b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:45.209164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cdc4b-b6bd-4aec-966c-75c53f290e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:45.210116 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cdc4b-b6bd-4aec-966c-75c53f290e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:45.210380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cdc4b-b6bd-4aec-966c-75c53f290e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:45.210788 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cdc4b-b6bd-4aec-966c-75c53f290e38 admin admin] PATH_INFO: `/v3/projects/4f71f832aa0d4398a11f72ca378f7cb7/users/38034c22af094027a134a6f5f53418db/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:45.227619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cdc4b-b6bd-4aec-966c-75c53f290e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f71f832aa0d4398a11f72ca378f7cb7, user_id=38034c22af094027a134a6f5f53418db, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:45.230737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cdc4b-b6bd-4aec-966c-75c53f290e38 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:45.303329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 939/1891] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:45 2022] PUT /identity/v3/projects/4f71f832aa0d4398a11f72ca378f7cb7/users/38034c22af094027a134a6f5f53418db/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:45.305124 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5530f43-5efa-419d-a697-c6ead0f123cc None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:45.305494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5530f43-5efa-419d-a697-c6ead0f123cc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:45.306178 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5530f43-5efa-419d-a697-c6ead0f123cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:45.334334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d5530f43-5efa-419d-a697-c6ead0f123cc None None] MFA Rules not processed for user `38034c22af094027a134a6f5f53418db`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:45.335801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d5530f43-5efa-419d-a697-c6ead0f123cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:45.401522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 953/1892] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:45.417545 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cdc4b-b6bd-4aec-966c-75c53f290e38 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:45.419282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-359cdc4b-b6bd-4aec-966c-75c53f290e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:45.444287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5530f43-5efa-419d-a697-c6ead0f123cc None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:45.446040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d5530f43-5efa-419d-a697-c6ead0f123cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:45.479334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cdc4b-b6bd-4aec-966c-75c53f290e38 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:45.484171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45c6ac-6990-495e-9949-8d6fddf71fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:45.484171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45c6ac-6990-495e-9949-8d6fddf71fea service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:45.484171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45c6ac-6990-495e-9949-8d6fddf71fea service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:45.484171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45c6ac-6990-495e-9949-8d6fddf71fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:45.493602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45c6ac-6990-495e-9949-8d6fddf71fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:45.495057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45c6ac-6990-495e-9949-8d6fddf71fea service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:45.504685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 940/1893] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:45.514229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5530f43-5efa-419d-a697-c6ead0f123cc None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:45.518922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:45.519731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:45.520013 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:45.520290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] PATH_INFO: `/v3/projects/3affaf4afdbc42f98b0c6c0507502f7c` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:45.521480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3affaf4afdbc42f98b0c6c0507502f7c)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:45.523440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:45.524144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45c6ac-6990-495e-9949-8d6fddf71fea service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:45.534513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45c6ac-6990-495e-9949-8d6fddf71fea service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:45.539746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b929f-44be-44e9-90a6-67de5aa83851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:45.540598 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b929f-44be-44e9-90a6-67de5aa83851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:45.541046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b929f-44be-44e9-90a6-67de5aa83851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:45.541371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b929f-44be-44e9-90a6-67de5aa83851 admin admin] PATH_INFO: `/v3/users/38034c22af094027a134a6f5f53418db` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:45.542583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b929f-44be-44e9-90a6-67de5aa83851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38034c22af094027a134a6f5f53418db)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:45.544561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b929f-44be-44e9-90a6-67de5aa83851 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:45.627743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3affaf4afdbc42f98b0c6c0507502f7c', 'request_id': 'req-2235f6c6-dd3d-4956-919d-04728acdc2bc'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.633533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3affaf4afdbc42f98b0c6c0507502f7c', 'request_id': 'req-2235f6c6-dd3d-4956-919d-04728acdc2bc'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.704460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a82b929f-44be-44e9-90a6-67de5aa83851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38034c22af094027a134a6f5f53418db'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.715802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a82b929f-44be-44e9-90a6-67de5aa83851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38034c22af094027a134a6f5f53418db'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.716619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3affaf4afdbc42f98b0c6c0507502f7c', 'request_id': 'req-2235f6c6-dd3d-4956-919d-04728acdc2bc'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.723307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a82b929f-44be-44e9-90a6-67de5aa83851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38034c22af094027a134a6f5f53418db'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.723996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a82b929f-44be-44e9-90a6-67de5aa83851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38034c22af094027a134a6f5f53418db'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.729533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] The token cache is being invalidate because project 3affaf4afdbc42f98b0c6c0507502f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:45.729902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.741273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.741273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 954/1894] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:45 2022] DELETE /identity/v3/projects/3affaf4afdbc42f98b0c6c0507502f7c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:45.741273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:45.741273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:45.798644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235f6c6-dd3d-4956-919d-04728acdc2bc admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:45.804168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:45.805037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:45.805323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:45.805597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] PATH_INFO: `/v3/users/4975c91f1cee40cab0931a20bc5baed1` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:45.806820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4975c91f1cee40cab0931a20bc5baed1)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:45.808206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a82b929f-44be-44e9-90a6-67de5aa83851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38034c22af094027a134a6f5f53418db'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.808810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:45.814516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 941/1895] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:45 2022] DELETE /identity/v3/users/38034c22af094027a134a6f5f53418db => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:45.818861 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e32fa8-f903-4795-96f2-08892853595b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:45.821646 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e32fa8-f903-4795-96f2-08892853595b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:45.821646 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e32fa8-f903-4795-96f2-08892853595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:45.836287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a7e32fa8-f903-4795-96f2-08892853595b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:45.837512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a7e32fa8-f903-4795-96f2-08892853595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:45.895450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 942/1896] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:45.905077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e32fa8-f903-4795-96f2-08892853595b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:45.906533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a7e32fa8-f903-4795-96f2-08892853595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:45.963524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e32fa8-f903-4795-96f2-08892853595b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:45.968824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48254f0c-2f7f-4aeb-a112-63220d3c04ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:45.969487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48254f0c-2f7f-4aeb-a112-63220d3c04ef service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:45.969765 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48254f0c-2f7f-4aeb-a112-63220d3c04ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:45.970043 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48254f0c-2f7f-4aeb-a112-63220d3c04ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:45.980326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4975c91f1cee40cab0931a20bc5baed1'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.981925 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48254f0c-2f7f-4aeb-a112-63220d3c04ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:45.984241 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48254f0c-2f7f-4aeb-a112-63220d3c04ef service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:45.994336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4975c91f1cee40cab0931a20bc5baed1'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.995164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4975c91f1cee40cab0931a20bc5baed1'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:45.999401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 943/1897] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:27:46.071397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4975c91f1cee40cab0931a20bc5baed1'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.079136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4975c91f1cee40cab0931a20bc5baed1'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.085801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 955/1898] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:45 2022] DELETE /identity/v3/users/4975c91f1cee40cab0931a20bc5baed1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:46.547354 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48254f0c-2f7f-4aeb-a112-63220d3c04ef service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:46.549866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-48254f0c-2f7f-4aeb-a112-63220d3c04ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:46.561600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:46.563088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:46.570052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48254f0c-2f7f-4aeb-a112-63220d3c04ef service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:46.632260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:46.632503 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3bc6a-eb28-489c-ac9c-d4263b96dc90 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:46.633131 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:46.633412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:46.633686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] PATH_INFO: `/v3/projects/4f71f832aa0d4398a11f72ca378f7cb7` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:46.634839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f71f832aa0d4398a11f72ca378f7cb7)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:46.636809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:46.637568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:46.638429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:46.638977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:46.639295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] PATH_INFO: `/v3/projects/42ac4003e8104f5d9b12ec5e39fe6341` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:46.640536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ac4003e8104f5d9b12ec5e39fe6341)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:46.642485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:46.767432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f71f832aa0d4398a11f72ca378f7cb7', 'request_id': 'req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.773128 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f71f832aa0d4398a11f72ca378f7cb7', 'request_id': 'req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.791970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ac4003e8104f5d9b12ec5e39fe6341', 'request_id': 'req-0dfe2226-f394-4d5c-899e-94ef103712ad'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.797716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ac4003e8104f5d9b12ec5e39fe6341', 'request_id': 'req-0dfe2226-f394-4d5c-899e-94ef103712ad'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.837179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f71f832aa0d4398a11f72ca378f7cb7', 'request_id': 'req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.850457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] The token cache is being invalidate because project 4f71f832aa0d4398a11f72ca378f7cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:46.850750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.851416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8cbd9c4a-d5ff-4640-9b15-4f499bd0a9c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.853060 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 944/1899] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:46 2022] DELETE /identity/v3/projects/4f71f832aa0d4398a11f72ca378f7cb7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:46.857713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd69594-4cbe-480b-9e0e-d67c16be7383 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:46.858040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd69594-4cbe-480b-9e0e-d67c16be7383 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:46.858447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd69594-4cbe-480b-9e0e-d67c16be7383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:46.875990 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1bd69594-4cbe-480b-9e0e-d67c16be7383 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:46.877202 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1bd69594-4cbe-480b-9e0e-d67c16be7383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:46.882742 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ac4003e8104f5d9b12ec5e39fe6341', 'request_id': 'req-0dfe2226-f394-4d5c-899e-94ef103712ad'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.895085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] The token cache is being invalidate because project 42ac4003e8104f5d9b12ec5e39fe6341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:46.895410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.896049 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0dfe2226-f394-4d5c-899e-94ef103712ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:46.897647 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 956/1900] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:46 2022] DELETE /identity/v3/projects/42ac4003e8104f5d9b12ec5e39fe6341 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:46.902314 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f43dc-2a44-4df4-af8c-0b8106a48c77 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:46.902608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f43dc-2a44-4df4-af8c-0b8106a48c77 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:46.902898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f43dc-2a44-4df4-af8c-0b8106a48c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:46.925140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-232f43dc-2a44-4df4-af8c-0b8106a48c77 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:46.926489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-232f43dc-2a44-4df4-af8c-0b8106a48c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:46.942884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 945/1901] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:46.958818 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438139e-cf13-424c-95bb-1877e8f1244a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:46.959166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438139e-cf13-424c-95bb-1877e8f1244a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:46.959460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438139e-cf13-424c-95bb-1877e8f1244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:46.978394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f438139e-cf13-424c-95bb-1877e8f1244a None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:46.979620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f438139e-cf13-424c-95bb-1877e8f1244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:46.987255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 957/1902] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:46.990760 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 946/1903] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:46.992159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f43dc-2a44-4df4-af8c-0b8106a48c77 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:46.995073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0d13-ad9d-4883-a3d9-070ced68ae53 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:46.995562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0d13-ad9d-4883-a3d9-070ced68ae53 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:46.996002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0d13-ad9d-4883-a3d9-070ced68ae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.001769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f43dc-2a44-4df4-af8c-0b8106a48c77 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.006339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d932d6-9fb6-484a-90d6-d47245b38022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.006991 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d932d6-9fb6-484a-90d6-d47245b38022 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.007300 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d932d6-9fb6-484a-90d6-d47245b38022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.007581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d932d6-9fb6-484a-90d6-d47245b38022 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.008312 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d932d6-9fb6-484a-90d6-d47245b38022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:47.008620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d932d6-9fb6-484a-90d6-d47245b38022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.010236 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d932d6-9fb6-484a-90d6-d47245b38022 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.014407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f07b0d13-ad9d-4883-a3d9-070ced68ae53 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:47.015644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f07b0d13-ad9d-4883-a3d9-070ced68ae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:47.022299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 958/1904] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:27:47.025741 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 947/1905] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:47.027981 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d932d6-9fb6-484a-90d6-d47245b38022 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.028097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b0d13-ad9d-4883-a3d9-070ced68ae53 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.039982 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b0d13-ad9d-4883-a3d9-070ced68ae53 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.040169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d932d6-9fb6-484a-90d6-d47245b38022 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.045430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58305d-7b5b-44c0-a8a5-56d8bf3d3c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.046088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58305d-7b5b-44c0-a8a5-56d8bf3d3c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.046365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58305d-7b5b-44c0-a8a5-56d8bf3d3c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.046635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58305d-7b5b-44c0-a8a5-56d8bf3d3c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.047385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58305d-7b5b-44c0-a8a5-56d8bf3d3c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:47.047687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58305d-7b5b-44c0-a8a5-56d8bf3d3c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.049296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58305d-7b5b-44c0-a8a5-56d8bf3d3c7c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.054175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdddf14-fa03-4fb3-979f-e03aab3b7366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.054842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdddf14-fa03-4fb3-979f-e03aab3b7366 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.055157 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdddf14-fa03-4fb3-979f-e03aab3b7366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.055435 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdddf14-fa03-4fb3-979f-e03aab3b7366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.056146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdddf14-fa03-4fb3-979f-e03aab3b7366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.058061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdddf14-fa03-4fb3-979f-e03aab3b7366 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.061643 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 948/1906] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:27:47.066018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58305d-7b5b-44c0-a8a5-56d8bf3d3c7c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.075744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58305d-7b5b-44c0-a8a5-56d8bf3d3c7c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.080868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ea7df-4ffd-4b1a-892d-57948069bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.081516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ea7df-4ffd-4b1a-892d-57948069bcf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.081802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ea7df-4ffd-4b1a-892d-57948069bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.082127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ea7df-4ffd-4b1a-892d-57948069bcf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.082816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ea7df-4ffd-4b1a-892d-57948069bcf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.084782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ea7df-4ffd-4b1a-892d-57948069bcf1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.151103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 959/1907] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:47 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:47.152193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdddf14-fa03-4fb3-979f-e03aab3b7366 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.183571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 949/1908] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:47 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:47.187679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ea7df-4ffd-4b1a-892d-57948069bcf1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.231720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdddf14-fa03-4fb3-979f-e03aab3b7366 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.262873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ea7df-4ffd-4b1a-892d-57948069bcf1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.268303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5af3f-aaf6-4d03-b6a9-7955bd646385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.269065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5af3f-aaf6-4d03-b6a9-7955bd646385 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.269419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5af3f-aaf6-4d03-b6a9-7955bd646385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.269765 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5af3f-aaf6-4d03-b6a9-7955bd646385 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.270616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5af3f-aaf6-4d03-b6a9-7955bd646385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.272673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5af3f-aaf6-4d03-b6a9-7955bd646385 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.295198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd661a-a1a9-407a-83cf-8fcd359c1339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.295863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd661a-a1a9-407a-83cf-8fcd359c1339 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.299340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd661a-a1a9-407a-83cf-8fcd359c1339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.299340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd661a-a1a9-407a-83cf-8fcd359c1339 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.299340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd661a-a1a9-407a-83cf-8fcd359c1339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.299340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd661a-a1a9-407a-83cf-8fcd359c1339 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.425718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 950/1909] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:47 2022] POST /identity/v3/users => generated 284 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:47.429545 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5af3f-aaf6-4d03-b6a9-7955bd646385 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.438829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5af3f-aaf6-4d03-b6a9-7955bd646385 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.444127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4ed5f-fde7-4623-94e0-3835bea6e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.444788 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ed5f-fde7-4623-94e0-3835bea6e256 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.445067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ed5f-fde7-4623-94e0-3835bea6e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.445342 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ed5f-fde7-4623-94e0-3835bea6e256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.446047 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4ed5f-fde7-4623-94e0-3835bea6e256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.447732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4ed5f-fde7-4623-94e0-3835bea6e256 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.458005 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 951/1910] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:47.461413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4ed5f-fde7-4623-94e0-3835bea6e256 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.470879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4ed5f-fde7-4623-94e0-3835bea6e256 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.474404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 960/1911] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:47 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:47.475449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd661a-a1a9-407a-83cf-8fcd359c1339 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.475589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7d387-892a-44a2-b81f-b7d8f778d95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.476126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7d387-892a-44a2-b81f-b7d8f778d95f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.476460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7d387-892a-44a2-b81f-b7d8f778d95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.476900 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7d387-892a-44a2-b81f-b7d8f778d95f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.477624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7d387-892a-44a2-b81f-b7d8f778d95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.479257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7d387-892a-44a2-b81f-b7d8f778d95f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.490466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 952/1912] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:27:47.494159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7d387-892a-44a2-b81f-b7d8f778d95f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.496634 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd661a-a1a9-407a-83cf-8fcd359c1339 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.505291 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7d387-892a-44a2-b81f-b7d8f778d95f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.506959 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772df960-dddb-4cd6-9f71-ee632f101032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.507698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df960-dddb-4cd6-9f71-ee632f101032 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.507988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df960-dddb-4cd6-9f71-ee632f101032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.508271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df960-dddb-4cd6-9f71-ee632f101032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.509299 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772df960-dddb-4cd6-9f71-ee632f101032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.511074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772df960-dddb-4cd6-9f71-ee632f101032 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.511214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4a262-03a8-485b-bc8e-cc4cf05dcc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.512472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a262-03a8-485b-bc8e-cc4cf05dcc60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.512804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a262-03a8-485b-bc8e-cc4cf05dcc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.513223 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a262-03a8-485b-bc8e-cc4cf05dcc60 admin admin] PATH_INFO: `/v3/projects/b5d40538b2504e9591a8e9c232ada83c/users/bb97e50d377d4c57b639d06e83c87efc/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.525050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 961/1913] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:47.529855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772df960-dddb-4cd6-9f71-ee632f101032 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.541078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4a262-03a8-485b-bc8e-cc4cf05dcc60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d40538b2504e9591a8e9c232ada83c, user_id=bb97e50d377d4c57b639d06e83c87efc, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.542163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772df960-dddb-4cd6-9f71-ee632f101032 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.545155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4a262-03a8-485b-bc8e-cc4cf05dcc60 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.548509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f23abe-1830-43c4-88fd-15255a9f64c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.550079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f23abe-1830-43c4-88fd-15255a9f64c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.550758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f23abe-1830-43c4-88fd-15255a9f64c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.551309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f23abe-1830-43c4-88fd-15255a9f64c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.552467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f23abe-1830-43c4-88fd-15255a9f64c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.557979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f23abe-1830-43c4-88fd-15255a9f64c9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.572018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 962/1914] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:47.575776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f23abe-1830-43c4-88fd-15255a9f64c9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.587741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f23abe-1830-43c4-88fd-15255a9f64c9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.594706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a64a80-47d0-407b-bfc9-dae3cda5f640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.595843 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a64a80-47d0-407b-bfc9-dae3cda5f640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.596201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a64a80-47d0-407b-bfc9-dae3cda5f640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.596553 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a64a80-47d0-407b-bfc9-dae3cda5f640 admin admin] PATH_INFO: `/v3/projects/1e8b971013bf492988f7119cf63c69bc/users/10e55f76eeaa46928289da220ceca447/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.613039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a64a80-47d0-407b-bfc9-dae3cda5f640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8b971013bf492988f7119cf63c69bc, user_id=10e55f76eeaa46928289da220ceca447, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.615864 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a64a80-47d0-407b-bfc9-dae3cda5f640 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.650282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 953/1915] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:47 2022] PUT /identity/v3/projects/b5d40538b2504e9591a8e9c232ada83c/users/bb97e50d377d4c57b639d06e83c87efc/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:47.681367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24fdf5-755c-42b9-b6e0-cc684bf09ea3 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.681367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24fdf5-755c-42b9-b6e0-cc684bf09ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.681367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24fdf5-755c-42b9-b6e0-cc684bf09ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.704486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5a24fdf5-755c-42b9-b6e0-cc684bf09ea3 None None] MFA Rules not processed for user `bb97e50d377d4c57b639d06e83c87efc`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:47.715071 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5a24fdf5-755c-42b9-b6e0-cc684bf09ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:47.715232 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 963/1916] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:47 2022] PUT /identity/v3/projects/1e8b971013bf492988f7119cf63c69bc/users/10e55f76eeaa46928289da220ceca447/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:47.716964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3940-aa06-4d44-8dec-b074d023f8fd None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.717426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3940-aa06-4d44-8dec-b074d023f8fd None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.717714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3940-aa06-4d44-8dec-b074d023f8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.753083 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c42a3940-aa06-4d44-8dec-b074d023f8fd None None] MFA Rules not processed for user `10e55f76eeaa46928289da220ceca447`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:47.754388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c42a3940-aa06-4d44-8dec-b074d023f8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:47.792214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 954/1917] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:47.793443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24fdf5-755c-42b9-b6e0-cc684bf09ea3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.828677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 964/1918] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:47.839472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3940-aa06-4d44-8dec-b074d023f8fd None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.841008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c42a3940-aa06-4d44-8dec-b074d023f8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:47.863162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24fdf5-755c-42b9-b6e0-cc684bf09ea3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.868006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4d344-fcc3-4748-adee-7db7004a2a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.868668 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d344-fcc3-4748-adee-7db7004a2a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.868946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d344-fcc3-4748-adee-7db7004a2a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.869218 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d344-fcc3-4748-adee-7db7004a2a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.870278 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4d344-fcc3-4748-adee-7db7004a2a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.871985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4d344-fcc3-4748-adee-7db7004a2a31 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.903201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3940-aa06-4d44-8dec-b074d023f8fd None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:47.906882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d1e61-dbf0-4823-84da-91447f89dfd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:47.907559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d1e61-dbf0-4823-84da-91447f89dfd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:47.907848 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d1e61-dbf0-4823-84da-91447f89dfd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:47.908160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d1e61-dbf0-4823-84da-91447f89dfd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:47.916833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d1e61-dbf0-4823-84da-91447f89dfd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:47.918351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d1e61-dbf0-4823-84da-91447f89dfd9 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:47.928304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 965/1919] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:27:47.975117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 955/1920] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:47 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:47.975410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d1e61-dbf0-4823-84da-91447f89dfd9 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:47.980963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d1e61-dbf0-4823-84da-91447f89dfd9 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:48.041660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb698c-6cfa-4884-9e66-79a58383b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:48.042336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb698c-6cfa-4884-9e66-79a58383b86e admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:48.042622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb698c-6cfa-4884-9e66-79a58383b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:48.042907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb698c-6cfa-4884-9e66-79a58383b86e admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:48.043675 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb698c-6cfa-4884-9e66-79a58383b86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:48.045749 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb698c-6cfa-4884-9e66-79a58383b86e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:48.150893 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 966/1921] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:47 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:27:48.154962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4d344-fcc3-4748-adee-7db7004a2a31 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:48.165841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4d344-fcc3-4748-adee-7db7004a2a31 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:48.170468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fb8c7-09d9-4b4c-8c6f-d5d291c5778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:48.171178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fb8c7-09d9-4b4c-8c6f-d5d291c5778d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:48.171463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fb8c7-09d9-4b4c-8c6f-d5d291c5778d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:48.171738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fb8c7-09d9-4b4c-8c6f-d5d291c5778d admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:48.172463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fb8c7-09d9-4b4c-8c6f-d5d291c5778d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:48.174800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fb8c7-09d9-4b4c-8c6f-d5d291c5778d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:48.186355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 956/1922] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:48.190349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb698c-6cfa-4884-9e66-79a58383b86e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:48.200782 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb698c-6cfa-4884-9e66-79a58383b86e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:48.205979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dcc5d-24ed-48c9-b5cf-6753d2fbb9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:48.206577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dcc5d-24ed-48c9-b5cf-6753d2fbb9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:48.206862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dcc5d-24ed-48c9-b5cf-6753d2fbb9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:48.207190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dcc5d-24ed-48c9-b5cf-6753d2fbb9ef admin admin] PATH_INFO: `/v3/projects/98efc684c37e4559aefc062ba34f72d6/users/e721a5c938ae4a4ea62d15e552bba813/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:48.222494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dcc5d-24ed-48c9-b5cf-6753d2fbb9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=98efc684c37e4559aefc062ba34f72d6, user_id=e721a5c938ae4a4ea62d15e552bba813, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:48.225190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dcc5d-24ed-48c9-b5cf-6753d2fbb9ef admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:48.316963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 967/1923] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:48 2022] PUT /identity/v3/projects/98efc684c37e4559aefc062ba34f72d6/users/e721a5c938ae4a4ea62d15e552bba813/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:27:48.320993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fb8c7-09d9-4b4c-8c6f-d5d291c5778d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:48.332105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fb8c7-09d9-4b4c-8c6f-d5d291c5778d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:48.398168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a8ec4-27b1-42b6-9892-951dc7af7bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:48.399041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8ec4-27b1-42b6-9892-951dc7af7bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:48.403038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8ec4-27b1-42b6-9892-951dc7af7bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:48.403038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8ec4-27b1-42b6-9892-951dc7af7bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:48.403038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a8ec4-27b1-42b6-9892-951dc7af7bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:48.403038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a8ec4-27b1-42b6-9892-951dc7af7bd9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:48.415387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 957/1924] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:48.417008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dcc5d-24ed-48c9-b5cf-6753d2fbb9ef admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:48.427203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dcc5d-24ed-48c9-b5cf-6753d2fbb9ef admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:48.432064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa7f42-4902-42e6-9930-0ff2f7e7e6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:48.432949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7f42-4902-42e6-9930-0ff2f7e7e6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:48.433234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7f42-4902-42e6-9930-0ff2f7e7e6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:48.433528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7f42-4902-42e6-9930-0ff2f7e7e6f2 admin admin] PATH_INFO: `/v3/projects/98efc684c37e4559aefc062ba34f72d6/users/e721a5c938ae4a4ea62d15e552bba813/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:48.435550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa7f42-4902-42e6-9930-0ff2f7e7e6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98efc684c37e4559aefc062ba34f72d6, user_id=e721a5c938ae4a4ea62d15e552bba813, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:48.438317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa7f42-4902-42e6-9930-0ff2f7e7e6f2 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:48.448654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 968/1925] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:48 2022] PUT /identity/v3/projects/98efc684c37e4559aefc062ba34f72d6/users/e721a5c938ae4a4ea62d15e552bba813/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:48.459942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09991-d4fc-4f88-bc2c-c1537ed957b8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:48.460241 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09991-d4fc-4f88-bc2c-c1537ed957b8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:48.460521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09991-d4fc-4f88-bc2c-c1537ed957b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:48.487697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-57e09991-d4fc-4f88-bc2c-c1537ed957b8 None None] MFA Rules not processed for user `e721a5c938ae4a4ea62d15e552bba813`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:48.488910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-57e09991-d4fc-4f88-bc2c-c1537ed957b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:48.556432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 958/1926] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:48.584079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa7f42-4902-42e6-9930-0ff2f7e7e6f2 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:48.644977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa7f42-4902-42e6-9930-0ff2f7e7e6f2 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:48.649115 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c56b61-cc93-42e9-ad39-e2e2325aecd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:48.649977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56b61-cc93-42e9-ad39-e2e2325aecd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:48.650396 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56b61-cc93-42e9-ad39-e2e2325aecd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:48.650814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56b61-cc93-42e9-ad39-e2e2325aecd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:48.662474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c56b61-cc93-42e9-ad39-e2e2325aecd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:48.663972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c56b61-cc93-42e9-ad39-e2e2325aecd2 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:48.676776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 969/1927] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:49.934921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054b373-ac55-4487-a778-ae31c0cf1abb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:49.935490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054b373-ac55-4487-a778-ae31c0cf1abb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:49.935490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054b373-ac55-4487-a778-ae31c0cf1abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:49.953418 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3054b373-ac55-4487-a778-ae31c0cf1abb None None] MFA Rules not processed for user `10e55f76eeaa46928289da220ceca447`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:49.954285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3054b373-ac55-4487-a778-ae31c0cf1abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:50.012517 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 959/1928] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:53.057801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c56b61-cc93-42e9-ad39-e2e2325aecd2 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:53.123268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c56b61-cc93-42e9-ad39-e2e2325aecd2 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:53.128004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:53.128877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:53.129159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:53.129428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] PATH_INFO: `/v3/users/bb97e50d377d4c57b639d06e83c87efc` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:53.130612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb97e50d377d4c57b639d06e83c87efc)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:53.132569 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:53.307388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb97e50d377d4c57b639d06e83c87efc'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:53.319372 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb97e50d377d4c57b639d06e83c87efc'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:53.320098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb97e50d377d4c57b639d06e83c87efc'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:53.385119 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb97e50d377d4c57b639d06e83c87efc'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:53.393336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb97e50d377d4c57b639d06e83c87efc'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:53.401061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 970/1929] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:53 2022] DELETE /identity/v3/users/bb97e50d377d4c57b639d06e83c87efc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:53.405710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca1e3-1c8c-4df8-bb86-5fcccb9db474 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:53.406251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca1e3-1c8c-4df8-bb86-5fcccb9db474 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:53.406624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca1e3-1c8c-4df8-bb86-5fcccb9db474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:53.425173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-98fca1e3-1c8c-4df8-bb86-5fcccb9db474 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:53.427334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-98fca1e3-1c8c-4df8-bb86-5fcccb9db474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:53.506173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 960/1930] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:53.515822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:53.518090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:53.596718 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae42230-d1e8-4c5a-a0c7-8257dc2782ad admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:53.601896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5342e-876f-4028-b68f-31f1a0606a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:53.602559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5342e-876f-4028-b68f-31f1a0606a8b service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:53.602895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5342e-876f-4028-b68f-31f1a0606a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:53.603119 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5342e-876f-4028-b68f-31f1a0606a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:53.631720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5342e-876f-4028-b68f-31f1a0606a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:53.632866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5342e-876f-4028-b68f-31f1a0606a8b service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:53.643961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 971/1931] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:54.157522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca1e3-1c8c-4df8-bb86-5fcccb9db474 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:54.159059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-98fca1e3-1c8c-4df8-bb86-5fcccb9db474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:54.172871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca1e3-1c8c-4df8-bb86-5fcccb9db474 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:54.177929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:54.178795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:54.179076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:54.179387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] PATH_INFO: `/v3/projects/b5d40538b2504e9591a8e9c232ada83c` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:54.180600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d40538b2504e9591a8e9c232ada83c)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:54.183042 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:54.293762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d40538b2504e9591a8e9c232ada83c', 'request_id': 'req-82f22573-9f6d-4917-9ae2-d727dc031d03'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:54.299610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d40538b2504e9591a8e9c232ada83c', 'request_id': 'req-82f22573-9f6d-4917-9ae2-d727dc031d03'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:54.379343 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d40538b2504e9591a8e9c232ada83c', 'request_id': 'req-82f22573-9f6d-4917-9ae2-d727dc031d03'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:54.390392 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] The token cache is being invalidate because project b5d40538b2504e9591a8e9c232ada83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:54.390681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:54.391338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:54.393401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 961/1932] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:54 2022] DELETE /identity/v3/projects/b5d40538b2504e9591a8e9c232ada83c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:54.397535 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5342e-876f-4028-b68f-31f1a0606a8b service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:54.411986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5342e-876f-4028-b68f-31f1a0606a8b service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:54.461848 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d91abc-487f-4571-b2c3-8b0877e0aa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:54.462758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91abc-487f-4571-b2c3-8b0877e0aa04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:54.463046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91abc-487f-4571-b2c3-8b0877e0aa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:54.463358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91abc-487f-4571-b2c3-8b0877e0aa04 admin admin] PATH_INFO: `/v3/users/e721a5c938ae4a4ea62d15e552bba813` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:54.464971 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d91abc-487f-4571-b2c3-8b0877e0aa04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e721a5c938ae4a4ea62d15e552bba813)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:54.466945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d91abc-487f-4571-b2c3-8b0877e0aa04 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:54.657423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-12d91abc-487f-4571-b2c3-8b0877e0aa04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e721a5c938ae4a4ea62d15e552bba813'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:54.673469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-12d91abc-487f-4571-b2c3-8b0877e0aa04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e721a5c938ae4a4ea62d15e552bba813'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:54.674208 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-12d91abc-487f-4571-b2c3-8b0877e0aa04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e721a5c938ae4a4ea62d15e552bba813'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:54.762329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-12d91abc-487f-4571-b2c3-8b0877e0aa04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e721a5c938ae4a4ea62d15e552bba813'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:54.770050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-12d91abc-487f-4571-b2c3-8b0877e0aa04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e721a5c938ae4a4ea62d15e552bba813'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:54.776113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 972/1933] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:54 2022] DELETE /identity/v3/users/e721a5c938ae4a4ea62d15e552bba813 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:55.180951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:55.182399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:55.196492 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f22573-9f6d-4917-9ae2-d727dc031d03 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:55.252295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:55.253167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:55.253446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:55.253719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] PATH_INFO: `/v3/projects/98efc684c37e4559aefc062ba34f72d6` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:55.254876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98efc684c37e4559aefc062ba34f72d6)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:55.256827 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:55.390547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98efc684c37e4559aefc062ba34f72d6', 'request_id': 'req-12313868-1d8e-45d7-a31f-ed0c86fefe15'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:55.396654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98efc684c37e4559aefc062ba34f72d6', 'request_id': 'req-12313868-1d8e-45d7-a31f-ed0c86fefe15'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:55.465103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98efc684c37e4559aefc062ba34f72d6', 'request_id': 'req-12313868-1d8e-45d7-a31f-ed0c86fefe15'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:55.476266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] The token cache is being invalidate because project 98efc684c37e4559aefc062ba34f72d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:55.476592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:55.477206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12313868-1d8e-45d7-a31f-ed0c86fefe15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:55.478867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 962/1934] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:55 2022] DELETE /identity/v3/projects/98efc684c37e4559aefc062ba34f72d6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:55.483753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46857e56-4964-4a9b-adf3-08381bec0b94 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:55.484235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46857e56-4964-4a9b-adf3-08381bec0b94 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:55.484325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46857e56-4964-4a9b-adf3-08381bec0b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:55.502876 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-46857e56-4964-4a9b-adf3-08381bec0b94 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:55.504193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-46857e56-4964-4a9b-adf3-08381bec0b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:55.560277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 973/1935] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:55.568081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3970df3-caac-412d-a2de-6a6ddf485980 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:55.568374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3970df3-caac-412d-a2de-6a6ddf485980 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:55.568686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3970df3-caac-412d-a2de-6a6ddf485980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:55.586597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d3970df3-caac-412d-a2de-6a6ddf485980 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:55.587880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d3970df3-caac-412d-a2de-6a6ddf485980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:55.597497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 963/1936] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:55.601769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46857e56-4964-4a9b-adf3-08381bec0b94 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:55.611480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46857e56-4964-4a9b-adf3-08381bec0b94 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:55.616748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcba30-788b-4e32-a7ef-05dcfadd44d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:55.617413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcba30-788b-4e32-a7ef-05dcfadd44d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:55.617701 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcba30-788b-4e32-a7ef-05dcfadd44d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:55.617986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcba30-788b-4e32-a7ef-05dcfadd44d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:55.618715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcba30-788b-4e32-a7ef-05dcfadd44d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:55.619030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcba30-788b-4e32-a7ef-05dcfadd44d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:55.620680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcba30-788b-4e32-a7ef-05dcfadd44d3 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:55.631932 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 974/1937] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:27:55.636158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3970df3-caac-412d-a2de-6a6ddf485980 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:55.646129 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3970df3-caac-412d-a2de-6a6ddf485980 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:55.650726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028c9c1-b9d4-48dc-ad5a-95e0ceac0f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:55.651400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c9c1-b9d4-48dc-ad5a-95e0ceac0f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:55.651685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c9c1-b9d4-48dc-ad5a-95e0ceac0f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:55.651960 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c9c1-b9d4-48dc-ad5a-95e0ceac0f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:55.652644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028c9c1-b9d4-48dc-ad5a-95e0ceac0f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:55.654575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028c9c1-b9d4-48dc-ad5a-95e0ceac0f00 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:55.733650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 964/1938] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:55 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:55.739659 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcba30-788b-4e32-a7ef-05dcfadd44d3 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:55.756227 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcba30-788b-4e32-a7ef-05dcfadd44d3 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:55.813167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03357f9-4d10-4a97-857d-3297c08bf663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:55.813833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03357f9-4d10-4a97-857d-3297c08bf663 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:55.814113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03357f9-4d10-4a97-857d-3297c08bf663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:55.814393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03357f9-4d10-4a97-857d-3297c08bf663 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:55.815194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03357f9-4d10-4a97-857d-3297c08bf663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:55.817123 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03357f9-4d10-4a97-857d-3297c08bf663 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:55.894740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 975/1939] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:55 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:55.898783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028c9c1-b9d4-48dc-ad5a-95e0ceac0f00 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:55.909526 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028c9c1-b9d4-48dc-ad5a-95e0ceac0f00 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:55.914309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad962e1-094e-4de1-9cf8-77f5cdd0eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:55.914987 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad962e1-094e-4de1-9cf8-77f5cdd0eda0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:55.915316 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad962e1-094e-4de1-9cf8-77f5cdd0eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:55.915585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad962e1-094e-4de1-9cf8-77f5cdd0eda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:55.922840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad962e1-094e-4de1-9cf8-77f5cdd0eda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:55.922840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad962e1-094e-4de1-9cf8-77f5cdd0eda0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:55.929403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 965/1940] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:55.933362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03357f9-4d10-4a97-857d-3297c08bf663 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:55.943409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03357f9-4d10-4a97-857d-3297c08bf663 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:55.948091 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640d1b7-30f4-4a28-a272-388b126c4744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:55.948752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640d1b7-30f4-4a28-a272-388b126c4744 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:55.949039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640d1b7-30f4-4a28-a272-388b126c4744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:55.949320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640d1b7-30f4-4a28-a272-388b126c4744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:55.950056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640d1b7-30f4-4a28-a272-388b126c4744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:55.951702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640d1b7-30f4-4a28-a272-388b126c4744 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:55.962304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 976/1941] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:55.966577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad962e1-094e-4de1-9cf8-77f5cdd0eda0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:55.977337 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad962e1-094e-4de1-9cf8-77f5cdd0eda0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:55.981776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35e9c3-3037-483f-b8da-4dadecd5240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:55.982637 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35e9c3-3037-483f-b8da-4dadecd5240a admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:55.982916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35e9c3-3037-483f-b8da-4dadecd5240a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:55.983239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35e9c3-3037-483f-b8da-4dadecd5240a admin admin] PATH_INFO: `/v3/projects/067cd6a9b44a43cf8b8ab1eb48da70df/users/fa87005ec07f4cfb857421793c5941fd/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:55.998016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35e9c3-3037-483f-b8da-4dadecd5240a admin admin] RBAC: Authorizing `identity:create_grant(project_id=067cd6a9b44a43cf8b8ab1eb48da70df, user_id=fa87005ec07f4cfb857421793c5941fd, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:56.000809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35e9c3-3037-483f-b8da-4dadecd5240a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:56.088637 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 966/1942] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:55 2022] PUT /identity/v3/projects/067cd6a9b44a43cf8b8ab1eb48da70df/users/fa87005ec07f4cfb857421793c5941fd/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:56.101277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f847c8-3f6b-4064-acb6-28b81bcaaf5b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:56.101622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f847c8-3f6b-4064-acb6-28b81bcaaf5b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:56.101907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f847c8-3f6b-4064-acb6-28b81bcaaf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:56.129165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a7f847c8-3f6b-4064-acb6-28b81bcaaf5b None None] MFA Rules not processed for user `fa87005ec07f4cfb857421793c5941fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:56.130416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a7f847c8-3f6b-4064-acb6-28b81bcaaf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:56.195752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 977/1943] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:56.200329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35e9c3-3037-483f-b8da-4dadecd5240a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:56.262147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35e9c3-3037-483f-b8da-4dadecd5240a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:56.266759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddeb341-4c4d-4939-a53b-0d09a4cfc27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:56.267474 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeb341-4c4d-4939-a53b-0d09a4cfc27b admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:56.267756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeb341-4c4d-4939-a53b-0d09a4cfc27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:56.268183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeb341-4c4d-4939-a53b-0d09a4cfc27b admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:56.268731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddeb341-4c4d-4939-a53b-0d09a4cfc27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:56.270672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddeb341-4c4d-4939-a53b-0d09a4cfc27b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:56.370137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 967/1944] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:56 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:56.374226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f847c8-3f6b-4064-acb6-28b81bcaaf5b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:56.384870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f847c8-3f6b-4064-acb6-28b81bcaaf5b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:56.439972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe35d43-0991-4688-af17-eacd01e650df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:56.440639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe35d43-0991-4688-af17-eacd01e650df admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:56.440929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe35d43-0991-4688-af17-eacd01e650df admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:56.441205 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe35d43-0991-4688-af17-eacd01e650df admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:56.441895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe35d43-0991-4688-af17-eacd01e650df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:56.443866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe35d43-0991-4688-af17-eacd01e650df admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:56.534904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 978/1945] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:56 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:56.538791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddeb341-4c4d-4939-a53b-0d09a4cfc27b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:56.548969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddeb341-4c4d-4939-a53b-0d09a4cfc27b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:56.554174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784b06c-0ee5-4f56-979d-f6bd8a5b3c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:56.554825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784b06c-0ee5-4f56-979d-f6bd8a5b3c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:56.555105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784b06c-0ee5-4f56-979d-f6bd8a5b3c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:56.555411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784b06c-0ee5-4f56-979d-f6bd8a5b3c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:56.556137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784b06c-0ee5-4f56-979d-f6bd8a5b3c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:56.557749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784b06c-0ee5-4f56-979d-f6bd8a5b3c90 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:56.567914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 968/1946] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:56.572203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe35d43-0991-4688-af17-eacd01e650df admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:56.582441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe35d43-0991-4688-af17-eacd01e650df admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:56.587044 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b77f9-7d4f-420b-939f-cbc700a4ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:56.587942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b77f9-7d4f-420b-939f-cbc700a4ba8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:56.588224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b77f9-7d4f-420b-939f-cbc700a4ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:56.588500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b77f9-7d4f-420b-939f-cbc700a4ba8d admin admin] PATH_INFO: `/v3/projects/e3398aa621c148b1aa82b88ab20b9337/users/37ed5b82f67f4b03bfe559d6fda290cb/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:56.603932 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b77f9-7d4f-420b-939f-cbc700a4ba8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3398aa621c148b1aa82b88ab20b9337, user_id=37ed5b82f67f4b03bfe559d6fda290cb, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:56.606625 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b77f9-7d4f-420b-939f-cbc700a4ba8d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:56.654011 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 979/1947] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:56 2022] PUT /identity/v3/projects/e3398aa621c148b1aa82b88ab20b9337/users/37ed5b82f67f4b03bfe559d6fda290cb/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:56.657927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784b06c-0ee5-4f56-979d-f6bd8a5b3c90 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:56.668656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784b06c-0ee5-4f56-979d-f6bd8a5b3c90 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:56.722826 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4e961-986d-4e46-b4c7-09484210f68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:56.723521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4e961-986d-4e46-b4c7-09484210f68c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:56.723806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4e961-986d-4e46-b4c7-09484210f68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:56.724081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4e961-986d-4e46-b4c7-09484210f68c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:56.724804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4e961-986d-4e46-b4c7-09484210f68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:56.726418 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4e961-986d-4e46-b4c7-09484210f68c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:56.738992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 969/1948] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:27:56.740628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b77f9-7d4f-420b-939f-cbc700a4ba8d admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:56.750686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b77f9-7d4f-420b-939f-cbc700a4ba8d admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:56.755328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e23b2-3baa-46e8-8a89-1a2b7628c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:56.756252 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e23b2-3baa-46e8-8a89-1a2b7628c5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:56.756484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e23b2-3baa-46e8-8a89-1a2b7628c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:56.756770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e23b2-3baa-46e8-8a89-1a2b7628c5c1 admin admin] PATH_INFO: `/v3/projects/e3398aa621c148b1aa82b88ab20b9337/users/37ed5b82f67f4b03bfe559d6fda290cb/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:56.758755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e23b2-3baa-46e8-8a89-1a2b7628c5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3398aa621c148b1aa82b88ab20b9337, user_id=37ed5b82f67f4b03bfe559d6fda290cb, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:56.761444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e23b2-3baa-46e8-8a89-1a2b7628c5c1 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:56.772653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 980/1949] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:27:56 2022] PUT /identity/v3/projects/e3398aa621c148b1aa82b88ab20b9337/users/37ed5b82f67f4b03bfe559d6fda290cb/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:56.782671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b11d5-7d5e-436a-be64-42b5d9e761e4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:56.782967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b11d5-7d5e-436a-be64-42b5d9e761e4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:56.786546 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b11d5-7d5e-436a-be64-42b5d9e761e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:56.809867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d23b11d5-7d5e-436a-be64-42b5d9e761e4 None None] MFA Rules not processed for user `37ed5b82f67f4b03bfe559d6fda290cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:56.811069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d23b11d5-7d5e-436a-be64-42b5d9e761e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:56.878482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 970/1950] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:56.889197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e23b2-3baa-46e8-8a89-1a2b7628c5c1 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:56.890980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c58e23b2-3baa-46e8-8a89-1a2b7628c5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:56.950273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e23b2-3baa-46e8-8a89-1a2b7628c5c1 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:56.954383 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b7dff-a48b-4976-acd6-a23f2fbadfe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:56.955151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b7dff-a48b-4976-acd6-a23f2fbadfe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:56.956080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b7dff-a48b-4976-acd6-a23f2fbadfe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:56.956438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b7dff-a48b-4976-acd6-a23f2fbadfe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:56.966052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b7dff-a48b-4976-acd6-a23f2fbadfe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:56.967562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b7dff-a48b-4976-acd6-a23f2fbadfe2 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:56.977583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 981/1951] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:57.103107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b11d5-7d5e-436a-be64-42b5d9e761e4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:57.171014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b11d5-7d5e-436a-be64-42b5d9e761e4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:57.175665 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:57.176824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:57.177110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:57.177383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] PATH_INFO: `/v3/users/fa87005ec07f4cfb857421793c5941fd` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:57.178576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa87005ec07f4cfb857421793c5941fd)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:57.180555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:57.341933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa87005ec07f4cfb857421793c5941fd'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:57.353978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa87005ec07f4cfb857421793c5941fd'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:57.360409 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa87005ec07f4cfb857421793c5941fd'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:57.361059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa87005ec07f4cfb857421793c5941fd'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:57.424452 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa87005ec07f4cfb857421793c5941fd'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:57.430327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 971/1952] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:57 2022] DELETE /identity/v3/users/fa87005ec07f4cfb857421793c5941fd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:57.435074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee14e6-580b-472c-9d79-26af47049417 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:57.436880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee14e6-580b-472c-9d79-26af47049417 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:57.436880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee14e6-580b-472c-9d79-26af47049417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:57.456479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-61ee14e6-580b-472c-9d79-26af47049417 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:57.457747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-61ee14e6-580b-472c-9d79-26af47049417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:57.516370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 982/1953] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:57.526569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:57.528023 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:57.583892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dce0fa-9553-4977-aff7-8802b02f5869 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:57.587468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389052-5534-4220-b7fb-ee0522bb60fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:57.588110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389052-5534-4220-b7fb-ee0522bb60fc service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:57.588391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389052-5534-4220-b7fb-ee0522bb60fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:57.588664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389052-5534-4220-b7fb-ee0522bb60fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:57.597790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d389052-5534-4220-b7fb-ee0522bb60fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:57.599268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d389052-5534-4220-b7fb-ee0522bb60fc service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:57.608920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 972/1954] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:27:57.992563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee14e6-580b-472c-9d79-26af47049417 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:57.994049 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-61ee14e6-580b-472c-9d79-26af47049417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:58.006952 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee14e6-580b-472c-9d79-26af47049417 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:58.011839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:58.012714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:58.013026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:58.017924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] PATH_INFO: `/v3/projects/067cd6a9b44a43cf8b8ab1eb48da70df` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:58.017924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067cd6a9b44a43cf8b8ab1eb48da70df)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:58.017924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:58.134084 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067cd6a9b44a43cf8b8ab1eb48da70df', 'request_id': 'req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:58.140121 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067cd6a9b44a43cf8b8ab1eb48da70df', 'request_id': 'req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:58.253323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067cd6a9b44a43cf8b8ab1eb48da70df', 'request_id': 'req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:58.264616 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] The token cache is being invalidate because project 067cd6a9b44a43cf8b8ab1eb48da70df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:58.264908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:58.265536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:58.267092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 983/1955] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:57 2022] DELETE /identity/v3/projects/067cd6a9b44a43cf8b8ab1eb48da70df => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:58.271186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389052-5534-4220-b7fb-ee0522bb60fc service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:58.280860 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389052-5534-4220-b7fb-ee0522bb60fc service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:58.338969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1526b-98fb-4b0c-b709-046e4b4ab87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:58.339893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1526b-98fb-4b0c-b709-046e4b4ab87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:58.340174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1526b-98fb-4b0c-b709-046e4b4ab87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:58.340449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1526b-98fb-4b0c-b709-046e4b4ab87b admin admin] PATH_INFO: `/v3/users/37ed5b82f67f4b03bfe559d6fda290cb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:58.341656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1526b-98fb-4b0c-b709-046e4b4ab87b admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ed5b82f67f4b03bfe559d6fda290cb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:58.343998 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1526b-98fb-4b0c-b709-046e4b4ab87b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:58.582481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2eb1526b-98fb-4b0c-b709-046e4b4ab87b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ed5b82f67f4b03bfe559d6fda290cb'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:58.594147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2eb1526b-98fb-4b0c-b709-046e4b4ab87b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ed5b82f67f4b03bfe559d6fda290cb'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:58.601932 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2eb1526b-98fb-4b0c-b709-046e4b4ab87b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ed5b82f67f4b03bfe559d6fda290cb'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:58.602619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2eb1526b-98fb-4b0c-b709-046e4b4ab87b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ed5b82f67f4b03bfe559d6fda290cb'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:58.660037 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2eb1526b-98fb-4b0c-b709-046e4b4ab87b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ed5b82f67f4b03bfe559d6fda290cb'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:58.666247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 973/1956] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:27:58 2022] DELETE /identity/v3/users/37ed5b82f67f4b03bfe559d6fda290cb => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:59.119260 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:59.120801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:59.138400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3424a-c87d-46b1-a3b4-54405e4b2ed7 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:59.269669 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:59.271109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:59.272691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:59.273455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] PATH_INFO: `/v3/projects/e3398aa621c148b1aa82b88ab20b9337` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:59.277423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3398aa621c148b1aa82b88ab20b9337)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:59.281964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:59.488501 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3398aa621c148b1aa82b88ab20b9337', 'request_id': 'req-f2d89945-1a33-4842-8444-dfd085b2996c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:59.494058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3398aa621c148b1aa82b88ab20b9337', 'request_id': 'req-f2d89945-1a33-4842-8444-dfd085b2996c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:59.602081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3398aa621c148b1aa82b88ab20b9337', 'request_id': 'req-f2d89945-1a33-4842-8444-dfd085b2996c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:59.614777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] The token cache is being invalidate because project e3398aa621c148b1aa82b88ab20b9337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:27:59.615266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:59.616028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f2d89945-1a33-4842-8444-dfd085b2996c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:27:59.621602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 984/1957] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:27:59 2022] DELETE /identity/v3/projects/e3398aa621c148b1aa82b88ab20b9337 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:27:59.623046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa2bd7-6897-4924-ac64-ebb97474ea58 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:59.623552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa2bd7-6897-4924-ac64-ebb97474ea58 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:59.623669 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa2bd7-6897-4924-ac64-ebb97474ea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:59.647166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d6fa2bd7-6897-4924-ac64-ebb97474ea58 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:59.648979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d6fa2bd7-6897-4924-ac64-ebb97474ea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:59.722859 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 974/1958] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:27:59.730635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543490b2-65f1-46b2-a70b-2cb4ecb00db9 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:59.730932 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543490b2-65f1-46b2-a70b-2cb4ecb00db9 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:59.731244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543490b2-65f1-46b2-a70b-2cb4ecb00db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:59.749341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-543490b2-65f1-46b2-a70b-2cb4ecb00db9 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:27:59.750520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-543490b2-65f1-46b2-a70b-2cb4ecb00db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:27:59.759757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 985/1959] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:27:59.763825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa2bd7-6897-4924-ac64-ebb97474ea58 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:59.774559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa2bd7-6897-4924-ac64-ebb97474ea58 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:59.781741 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4360-9868-4aad-9f20-75c90fa7b83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:59.782422 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4360-9868-4aad-9f20-75c90fa7b83b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:59.782681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4360-9868-4aad-9f20-75c90fa7b83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:59.782952 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4360-9868-4aad-9f20-75c90fa7b83b admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:59.783822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa4360-9868-4aad-9f20-75c90fa7b83b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:27:59.784283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa4360-9868-4aad-9f20-75c90fa7b83b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:59.786084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa4360-9868-4aad-9f20-75c90fa7b83b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:59.800248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 975/1960] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:27:59.804615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543490b2-65f1-46b2-a70b-2cb4ecb00db9 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:59.826165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543490b2-65f1-46b2-a70b-2cb4ecb00db9 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:27:59.832217 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfa218-0c43-486e-b696-ffa540e6043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:27:59.834016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfa218-0c43-486e-b696-ffa540e6043e admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:27:59.834016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfa218-0c43-486e-b696-ffa540e6043e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:27:59.834016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfa218-0c43-486e-b696-ffa540e6043e admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:27:59.834744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfa218-0c43-486e-b696-ffa540e6043e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:27:59.836885 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfa218-0c43-486e-b696-ffa540e6043e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:27:59.911466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 986/1961] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:27:59 2022] POST /identity/v3/projects => generated 407 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:27:59.914688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4360-9868-4aad-9f20-75c90fa7b83b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:27:59.927233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4360-9868-4aad-9f20-75c90fa7b83b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:00.007920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c7ccb-13e9-4697-842f-4f6a8fa98477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:00.008614 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7ccb-13e9-4697-842f-4f6a8fa98477 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:00.009150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7ccb-13e9-4697-842f-4f6a8fa98477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:00.009426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7ccb-13e9-4697-842f-4f6a8fa98477 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:00.010194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c7ccb-13e9-4697-842f-4f6a8fa98477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:00.012338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c7ccb-13e9-4697-842f-4f6a8fa98477 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:00.122306 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 976/1962] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:27:59 2022] POST /identity/v3/users => generated 304 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:00.126518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfa218-0c43-486e-b696-ffa540e6043e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:00.139201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfa218-0c43-486e-b696-ffa540e6043e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:00.143956 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e390e9-51dd-430d-893f-0944cd404c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:00.144645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e390e9-51dd-430d-893f-0944cd404c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:00.144911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e390e9-51dd-430d-893f-0944cd404c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:00.145189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e390e9-51dd-430d-893f-0944cd404c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:00.145919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e390e9-51dd-430d-893f-0944cd404c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:00.148335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e390e9-51dd-430d-893f-0944cd404c05 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:00.161654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 987/1963] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:00.166448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c7ccb-13e9-4697-842f-4f6a8fa98477 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:00.177530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c7ccb-13e9-4697-842f-4f6a8fa98477 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:00.182938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75303d3-eab8-49bc-892c-0679c9a4b8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:00.183410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75303d3-eab8-49bc-892c-0679c9a4b8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:00.183810 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75303d3-eab8-49bc-892c-0679c9a4b8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:00.184086 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75303d3-eab8-49bc-892c-0679c9a4b8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:00.184811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75303d3-eab8-49bc-892c-0679c9a4b8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:00.187067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75303d3-eab8-49bc-892c-0679c9a4b8d7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:00.201052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 977/1964] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:00.205199 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e390e9-51dd-430d-893f-0944cd404c05 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:00.216456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e390e9-51dd-430d-893f-0944cd404c05 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:00.221527 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f427eba-9e9e-4e92-a476-f4e5bac27214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:00.222498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427eba-9e9e-4e92-a476-f4e5bac27214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:00.222844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427eba-9e9e-4e92-a476-f4e5bac27214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:00.223223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427eba-9e9e-4e92-a476-f4e5bac27214 admin admin] PATH_INFO: `/v3/projects/b913af5b04044f4a931818385cd16d85/users/fe0586f5bde144389c0b667efbc05e9e/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:00.239571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f427eba-9e9e-4e92-a476-f4e5bac27214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b913af5b04044f4a931818385cd16d85, user_id=fe0586f5bde144389c0b667efbc05e9e, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:00.242552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f427eba-9e9e-4e92-a476-f4e5bac27214 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:00.363509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 988/1965] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:00 2022] PUT /identity/v3/projects/b913af5b04044f4a931818385cd16d85/users/fe0586f5bde144389c0b667efbc05e9e/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:00.378038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4813-b9f9-4cc3-97ac-657aedd9df8a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:00.378406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4813-b9f9-4cc3-97ac-657aedd9df8a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:00.378623 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4813-b9f9-4cc3-97ac-657aedd9df8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:00.408199 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-88fa4813-b9f9-4cc3-97ac-657aedd9df8a None None] MFA Rules not processed for user `fe0586f5bde144389c0b667efbc05e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:00.410102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-88fa4813-b9f9-4cc3-97ac-657aedd9df8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:00.523026 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 978/1966] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:00.527497 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f427eba-9e9e-4e92-a476-f4e5bac27214 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:00.627784 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f427eba-9e9e-4e92-a476-f4e5bac27214 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:00.634127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355be2e2-3525-42db-9989-5f0b60676dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:00.635253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355be2e2-3525-42db-9989-5f0b60676dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:00.635726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355be2e2-3525-42db-9989-5f0b60676dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:00.636162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355be2e2-3525-42db-9989-5f0b60676dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:00.636889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355be2e2-3525-42db-9989-5f0b60676dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:00.638827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355be2e2-3525-42db-9989-5f0b60676dd5 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:00.739938 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 989/1967] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:00 2022] POST /identity/v3/projects => generated 407 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:00.743998 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa4813-b9f9-4cc3-97ac-657aedd9df8a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:00.760237 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa4813-b9f9-4cc3-97ac-657aedd9df8a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:00.829721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abc731-ec85-4c06-8691-f8720c9d8e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:00.830323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abc731-ec85-4c06-8691-f8720c9d8e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:00.831347 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abc731-ec85-4c06-8691-f8720c9d8e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:00.831627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abc731-ec85-4c06-8691-f8720c9d8e06 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:00.832327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abc731-ec85-4c06-8691-f8720c9d8e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:00.834286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abc731-ec85-4c06-8691-f8720c9d8e06 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:01.029714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 979/1968] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:00 2022] POST /identity/v3/users => generated 310 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:01.030969 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355be2e2-3525-42db-9989-5f0b60676dd5 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:01.041744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355be2e2-3525-42db-9989-5f0b60676dd5 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:01.046530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b29305-fcb0-4b39-8500-bff090132bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:01.047254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b29305-fcb0-4b39-8500-bff090132bee admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:01.047780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b29305-fcb0-4b39-8500-bff090132bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:01.048292 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b29305-fcb0-4b39-8500-bff090132bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:01.049247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b29305-fcb0-4b39-8500-bff090132bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:01.051477 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b29305-fcb0-4b39-8500-bff090132bee admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:01.062680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 990/1969] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:01.067015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abc731-ec85-4c06-8691-f8720c9d8e06 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:01.083254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abc731-ec85-4c06-8691-f8720c9d8e06 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:01.097414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3af9d3-0a05-4924-bab8-5cdac14dc9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:01.102388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3af9d3-0a05-4924-bab8-5cdac14dc9a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:01.102388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3af9d3-0a05-4924-bab8-5cdac14dc9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:01.102388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3af9d3-0a05-4924-bab8-5cdac14dc9a3 admin admin] PATH_INFO: `/v3/projects/54540f78bd5444b59da0756baf671e57/users/7f43bb05a9d84cf4b75bd4be0296f043/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:01.116933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3af9d3-0a05-4924-bab8-5cdac14dc9a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54540f78bd5444b59da0756baf671e57, user_id=7f43bb05a9d84cf4b75bd4be0296f043, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:01.121115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3af9d3-0a05-4924-bab8-5cdac14dc9a3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:01.244092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 980/1970] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:01 2022] PUT /identity/v3/projects/54540f78bd5444b59da0756baf671e57/users/7f43bb05a9d84cf4b75bd4be0296f043/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:01.246194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b29305-fcb0-4b39-8500-bff090132bee admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:01.262520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b29305-fcb0-4b39-8500-bff090132bee admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:01.328141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90ada7-5211-401a-bb99-cf45937dab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:01.329189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90ada7-5211-401a-bb99-cf45937dab02 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:01.329189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90ada7-5211-401a-bb99-cf45937dab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:01.329353 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90ada7-5211-401a-bb99-cf45937dab02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:01.330259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90ada7-5211-401a-bb99-cf45937dab02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:01.332067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90ada7-5211-401a-bb99-cf45937dab02 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:01.342833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 991/1971] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:01.347937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3af9d3-0a05-4924-bab8-5cdac14dc9a3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:01.390671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3af9d3-0a05-4924-bab8-5cdac14dc9a3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:01.395990 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367f4de-557c-4e0f-b371-23af43e0a288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:01.402106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367f4de-557c-4e0f-b371-23af43e0a288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:01.402106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367f4de-557c-4e0f-b371-23af43e0a288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:01.402106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367f4de-557c-4e0f-b371-23af43e0a288 admin admin] PATH_INFO: `/v3/projects/54540f78bd5444b59da0756baf671e57/users/7f43bb05a9d84cf4b75bd4be0296f043/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:01.402106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367f4de-557c-4e0f-b371-23af43e0a288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54540f78bd5444b59da0756baf671e57, user_id=7f43bb05a9d84cf4b75bd4be0296f043, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:01.402431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367f4de-557c-4e0f-b371-23af43e0a288 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:01.413835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 981/1972] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:01 2022] PUT /identity/v3/projects/54540f78bd5444b59da0756baf671e57/users/7f43bb05a9d84cf4b75bd4be0296f043/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:01.424292 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894cead-553a-426c-a5f3-bfd4a45bc704 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:01.428623 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894cead-553a-426c-a5f3-bfd4a45bc704 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:01.428623 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894cead-553a-426c-a5f3-bfd4a45bc704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:01.452831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a894cead-553a-426c-a5f3-bfd4a45bc704 None None] MFA Rules not processed for user `7f43bb05a9d84cf4b75bd4be0296f043`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:01.453828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a894cead-553a-426c-a5f3-bfd4a45bc704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:01.555680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 992/1973] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:01 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:01.566484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367f4de-557c-4e0f-b371-23af43e0a288 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:01.568315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6367f4de-557c-4e0f-b371-23af43e0a288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:01.626529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367f4de-557c-4e0f-b371-23af43e0a288 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:01.630355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf385014-4ce4-4031-8a76-6a18144d33c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:01.631005 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385014-4ce4-4031-8a76-6a18144d33c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:01.631328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385014-4ce4-4031-8a76-6a18144d33c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:01.631601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385014-4ce4-4031-8a76-6a18144d33c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:01.643902 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf385014-4ce4-4031-8a76-6a18144d33c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:01.645773 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf385014-4ce4-4031-8a76-6a18144d33c9 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:01.657578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 982/1974] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:02.123493 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894cead-553a-426c-a5f3-bfd4a45bc704 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:02.133931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894cead-553a-426c-a5f3-bfd4a45bc704 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:02.137597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59368235-98c4-48d1-bdf9-e41170ac7a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:02.138256 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59368235-98c4-48d1-bdf9-e41170ac7a07 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:02.138573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59368235-98c4-48d1-bdf9-e41170ac7a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:02.138821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59368235-98c4-48d1-bdf9-e41170ac7a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:02.210738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59368235-98c4-48d1-bdf9-e41170ac7a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:02.218275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59368235-98c4-48d1-bdf9-e41170ac7a07 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:02.222881 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 993/1975] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:02 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:03.810360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf385014-4ce4-4031-8a76-6a18144d33c9 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:03.811824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-cf385014-4ce4-4031-8a76-6a18144d33c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:03.955189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59368235-98c4-48d1-bdf9-e41170ac7a07 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:03.957933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-59368235-98c4-48d1-bdf9-e41170ac7a07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:03.988546 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf385014-4ce4-4031-8a76-6a18144d33c9 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:04.001971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95ce51-1079-4fe4-9c96-d469fd097e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:04.004012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95ce51-1079-4fe4-9c96-d469fd097e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:04.005381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95ce51-1079-4fe4-9c96-d469fd097e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:04.005381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95ce51-1079-4fe4-9c96-d469fd097e43 admin admin] PATH_INFO: `/v3/users/362d85d17b9049a9b096c80063f7411f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:04.007337 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95ce51-1079-4fe4-9c96-d469fd097e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=362d85d17b9049a9b096c80063f7411f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:04.013496 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95ce51-1079-4fe4-9c96-d469fd097e43 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:04.095884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59368235-98c4-48d1-bdf9-e41170ac7a07 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:04.101181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48a5c1-120c-4dc2-9392-7821198832e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:04.102148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a5c1-120c-4dc2-9392-7821198832e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:04.102516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a5c1-120c-4dc2-9392-7821198832e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:04.102848 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48a5c1-120c-4dc2-9392-7821198832e9 admin admin] PATH_INFO: `/v3/users/0491be30c88b4ac98b498172ac8e3d1f` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:04.105613 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48a5c1-120c-4dc2-9392-7821198832e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0491be30c88b4ac98b498172ac8e3d1f)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:04.107813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48a5c1-120c-4dc2-9392-7821198832e9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:04.200825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5c95ce51-1079-4fe4-9c96-d469fd097e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362d85d17b9049a9b096c80063f7411f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:04.228946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5c95ce51-1079-4fe4-9c96-d469fd097e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362d85d17b9049a9b096c80063f7411f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:04.241156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5c95ce51-1079-4fe4-9c96-d469fd097e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362d85d17b9049a9b096c80063f7411f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:04.243500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5c95ce51-1079-4fe4-9c96-d469fd097e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362d85d17b9049a9b096c80063f7411f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:04.279528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ee48a5c1-120c-4dc2-9392-7821198832e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0491be30c88b4ac98b498172ac8e3d1f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:04.296042 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ee48a5c1-120c-4dc2-9392-7821198832e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0491be30c88b4ac98b498172ac8e3d1f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:04.296836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ee48a5c1-120c-4dc2-9392-7821198832e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0491be30c88b4ac98b498172ac8e3d1f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:04.310864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5c95ce51-1079-4fe4-9c96-d469fd097e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362d85d17b9049a9b096c80063f7411f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:04.317629 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 983/1976] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:03 2022] DELETE /identity/v3/users/362d85d17b9049a9b096c80063f7411f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:04.322172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9a88-57a3-44d5-9c3a-724473a78eb4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:04.322564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9a88-57a3-44d5-9c3a-724473a78eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:04.322747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9a88-57a3-44d5-9c3a-724473a78eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:04.351144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ebff9a88-57a3-44d5-9c3a-724473a78eb4 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:04.352632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ebff9a88-57a3-44d5-9c3a-724473a78eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:04.356552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ee48a5c1-120c-4dc2-9392-7821198832e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0491be30c88b4ac98b498172ac8e3d1f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:04.369769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ee48a5c1-120c-4dc2-9392-7821198832e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0491be30c88b4ac98b498172ac8e3d1f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:04.379082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 994/1977] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:03 2022] DELETE /identity/v3/users/0491be30c88b4ac98b498172ac8e3d1f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:04.385395 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9336a5-cbd9-409b-a2cd-7983b0089b31 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:04.385938 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9336a5-cbd9-409b-a2cd-7983b0089b31 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:04.386469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9336a5-cbd9-409b-a2cd-7983b0089b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:04.413271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-af9336a5-cbd9-409b-a2cd-7983b0089b31 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:04.415595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-af9336a5-cbd9-409b-a2cd-7983b0089b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:04.463483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 984/1978] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:04.495493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9a88-57a3-44d5-9c3a-724473a78eb4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:04.497795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ebff9a88-57a3-44d5-9c3a-724473a78eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:04.508602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 995/1979] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:04.516600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9336a5-cbd9-409b-a2cd-7983b0089b31 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:04.518952 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-af9336a5-cbd9-409b-a2cd-7983b0089b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:04.568856 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9a88-57a3-44d5-9c3a-724473a78eb4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:04.613634 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9336a5-cbd9-409b-a2cd-7983b0089b31 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:04.618748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe9fe9-d99d-4911-b05b-c16e9b00db54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:04.620419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe9fe9-d99d-4911-b05b-c16e9b00db54 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:04.620419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe9fe9-d99d-4911-b05b-c16e9b00db54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:04.620419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe9fe9-d99d-4911-b05b-c16e9b00db54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:04.632048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80827dba-0aa0-40ac-91a7-02359d6d42a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:04.632251 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe9fe9-d99d-4911-b05b-c16e9b00db54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:04.632719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80827dba-0aa0-40ac-91a7-02359d6d42a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:04.633001 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80827dba-0aa0-40ac-91a7-02359d6d42a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:04.633280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80827dba-0aa0-40ac-91a7-02359d6d42a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:04.633813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe9fe9-d99d-4911-b05b-c16e9b00db54 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:04.645313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80827dba-0aa0-40ac-91a7-02359d6d42a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:04.646927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80827dba-0aa0-40ac-91a7-02359d6d42a8 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:04.648351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 996/1980] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:04.663270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 985/1981] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:05.329915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe9fe9-d99d-4911-b05b-c16e9b00db54 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:05.332031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-24fe9fe9-d99d-4911-b05b-c16e9b00db54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:05.347249 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe9fe9-d99d-4911-b05b-c16e9b00db54 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:05.352112 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:05.352986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:05.353655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:05.353655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] PATH_INFO: `/v3/projects/71bfccc4d0054dc28c0acaf90247fc9d` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:05.354739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bfccc4d0054dc28c0acaf90247fc9d)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:05.356705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:05.479996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80827dba-0aa0-40ac-91a7-02359d6d42a8 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:05.481524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-80827dba-0aa0-40ac-91a7-02359d6d42a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:05.493337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bfccc4d0054dc28c0acaf90247fc9d', 'request_id': 'req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.495960 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80827dba-0aa0-40ac-91a7-02359d6d42a8 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:05.503193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bfccc4d0054dc28c0acaf90247fc9d', 'request_id': 'req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.561378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:05.562267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:05.562547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:05.562817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] PATH_INFO: `/v3/projects/6e4f13950b364baebe7ea996f9165748` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:05.564059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4f13950b364baebe7ea996f9165748)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:05.566688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:05.590573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bfccc4d0054dc28c0acaf90247fc9d', 'request_id': 'req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.602970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] The token cache is being invalidate because project 71bfccc4d0054dc28c0acaf90247fc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:05.603232 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.603886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.605452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 997/1982] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:05 2022] DELETE /identity/v3/projects/71bfccc4d0054dc28c0acaf90247fc9d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:05.609410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:05.610815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:05.623434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b19aa-1f9c-4f29-a44c-17d74feb9e6c admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:05.628886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c6025-4039-4626-bb1d-e57e5074a74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:05.629919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c6025-4039-4626-bb1d-e57e5074a74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:05.630211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c6025-4039-4626-bb1d-e57e5074a74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:05.630489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c6025-4039-4626-bb1d-e57e5074a74d admin admin] PATH_INFO: `/v3/users/54c73533d8c04bc88398d96fa52f47ad` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:05.631731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c6025-4039-4626-bb1d-e57e5074a74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c73533d8c04bc88398d96fa52f47ad)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:05.633738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c6025-4039-4626-bb1d-e57e5074a74d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:05.716973 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4f13950b364baebe7ea996f9165748', 'request_id': 'req-af0ab983-e5c2-4f2b-886e-f61307a62cbc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.721694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4f13950b364baebe7ea996f9165748', 'request_id': 'req-af0ab983-e5c2-4f2b-886e-f61307a62cbc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.813518 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4f13950b364baebe7ea996f9165748', 'request_id': 'req-af0ab983-e5c2-4f2b-886e-f61307a62cbc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.825995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] The token cache is being invalidate because project 6e4f13950b364baebe7ea996f9165748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:05.826280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.826962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-af0ab983-e5c2-4f2b-886e-f61307a62cbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.828507 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 986/1983] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:05 2022] DELETE /identity/v3/projects/6e4f13950b364baebe7ea996f9165748 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:05.833375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d087d-0c57-4e3f-a6e3-62a8d738c2e7 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:05.833659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d087d-0c57-4e3f-a6e3-62a8d738c2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:05.833942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d087d-0c57-4e3f-a6e3-62a8d738c2e7 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:05.835580 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 987/1984] 10.222.0.64 () {54 vars in 921 bytes} [Fri May 13 17:28:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:28:05.836242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d087d-0c57-4e3f-a6e3-62a8d738c2e7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:05.838039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-221d087d-0c57-4e3f-a6e3-62a8d738c2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:05.852410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-015c6025-4039-4626-bb1d-e57e5074a74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c73533d8c04bc88398d96fa52f47ad'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.865394 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-015c6025-4039-4626-bb1d-e57e5074a74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c73533d8c04bc88398d96fa52f47ad'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.866093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-015c6025-4039-4626-bb1d-e57e5074a74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c73533d8c04bc88398d96fa52f47ad'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.910684 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d087d-0c57-4e3f-a6e3-62a8d738c2e7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:05.916108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:05.916982 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:05.917262 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:05.917540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] PATH_INFO: `/v3/users/0a52f57f034f4cca8ffef688c6950179` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:05.918802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a52f57f034f4cca8ffef688c6950179)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:05.920819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:05.967999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-015c6025-4039-4626-bb1d-e57e5074a74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c73533d8c04bc88398d96fa52f47ad'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.976625 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-015c6025-4039-4626-bb1d-e57e5074a74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c73533d8c04bc88398d96fa52f47ad'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:05.983167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 998/1985] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:05 2022] DELETE /identity/v3/users/54c73533d8c04bc88398d96fa52f47ad => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:05.984341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe91a-8a9f-4ceb-9ff8-08634ba5eb00 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:05.984628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe91a-8a9f-4ceb-9ff8-08634ba5eb00 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:05.984909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fe91a-8a9f-4ceb-9ff8-08634ba5eb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:06.005827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a28fe91a-8a9f-4ceb-9ff8-08634ba5eb00 None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:06.012067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a28fe91a-8a9f-4ceb-9ff8-08634ba5eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:06.084259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 999/1986] 10.222.0.64 () {58 vars in 1018 bytes} [Fri May 13 17:28:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:06.102934 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fe91a-8a9f-4ceb-9ff8-08634ba5eb00 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:06.104506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a28fe91a-8a9f-4ceb-9ff8-08634ba5eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:06.108594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a52f57f034f4cca8ffef688c6950179'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:06.118097 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fe91a-8a9f-4ceb-9ff8-08634ba5eb00 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:06.124474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bfe84-1c8f-4d35-acdf-cf107f265a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:06.125278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bfe84-1c8f-4d35-acdf-cf107f265a12 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:06.125693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bfe84-1c8f-4d35-acdf-cf107f265a12 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:06.126104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bfe84-1c8f-4d35-acdf-cf107f265a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:06.128315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a52f57f034f4cca8ffef688c6950179'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:06.135482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a52f57f034f4cca8ffef688c6950179'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:06.136655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bfe84-1c8f-4d35-acdf-cf107f265a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:06.136816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a52f57f034f4cca8ffef688c6950179'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:06.138405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bfe84-1c8f-4d35-acdf-cf107f265a12 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:06.149540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1000/1987] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:06.248161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a52f57f034f4cca8ffef688c6950179'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:06.255975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 988/1988] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:05 2022] DELETE /identity/v3/users/0a52f57f034f4cca8ffef688c6950179 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:06.420542 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bfe84-1c8f-4d35-acdf-cf107f265a12 service nova] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:06.422109 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2d1bfe84-1c8f-4d35-acdf-cf107f265a12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:06.503836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bfe84-1c8f-4d35-acdf-cf107f265a12 service nova] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:06.610004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:06.611085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:06.611531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:06.612089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] PATH_INFO: `/v3/projects/bafa2ea73315479fbcc99b04e3ab2299` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:06.613470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bafa2ea73315479fbcc99b04e3ab2299)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:06.615583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:06.743036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bafa2ea73315479fbcc99b04e3ab2299', 'request_id': 'req-6ea8839e-5a21-4de0-8936-528d228c9a3b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:06.749049 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bafa2ea73315479fbcc99b04e3ab2299', 'request_id': 'req-6ea8839e-5a21-4de0-8936-528d228c9a3b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:06.768720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:06.771063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:06.787814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84f68b-8d66-4888-8bbd-6d87e3eda3f7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:06.807676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bafa2ea73315479fbcc99b04e3ab2299', 'request_id': 'req-6ea8839e-5a21-4de0-8936-528d228c9a3b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:06.821889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] The token cache is being invalidate because project bafa2ea73315479fbcc99b04e3ab2299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:06.822174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:06.822869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6ea8839e-5a21-4de0-8936-528d228c9a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:06.824541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1001/1989] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:06 2022] DELETE /identity/v3/projects/bafa2ea73315479fbcc99b04e3ab2299 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:06.829160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c26059-8b0c-4224-9495-8c165e0078b3 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:06.832524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c26059-8b0c-4224-9495-8c165e0078b3 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:06.832524 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c26059-8b0c-4224-9495-8c165e0078b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:06.852017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-64c26059-8b0c-4224-9495-8c165e0078b3 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:06.853228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-64c26059-8b0c-4224-9495-8c165e0078b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:06.853747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:06.854687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:06.855040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:06.855478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] PATH_INFO: `/v3/projects/ded0eeba6dda4c32b62cd539396e59d8` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:06.861106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded0eeba6dda4c32b62cd539396e59d8)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:06.861106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:06.867788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1002/1990] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:06.869455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c062-6859-4e85-8c63-a659b37f5840 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:06.869455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c062-6859-4e85-8c63-a659b37f5840 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:06.869736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c062-6859-4e85-8c63-a659b37f5840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:06.889646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-4781c062-6859-4e85-8c63-a659b37f5840 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:06.891181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-4781c062-6859-4e85-8c63-a659b37f5840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:06.899481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1003/1991] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:06.903592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781c062-6859-4e85-8c63-a659b37f5840 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:06.912961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781c062-6859-4e85-8c63-a659b37f5840 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:06.917776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e558c9e-f337-43da-84ac-dbe7c517c5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:06.918522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558c9e-f337-43da-84ac-dbe7c517c5af admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:06.918877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558c9e-f337-43da-84ac-dbe7c517c5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:06.919263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558c9e-f337-43da-84ac-dbe7c517c5af admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:06.920089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e558c9e-f337-43da-84ac-dbe7c517c5af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:06.920462 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e558c9e-f337-43da-84ac-dbe7c517c5af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:06.922141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e558c9e-f337-43da-84ac-dbe7c517c5af admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:06.934374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1004/1992] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:28:06.938664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e558c9e-f337-43da-84ac-dbe7c517c5af admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:06.948771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e558c9e-f337-43da-84ac-dbe7c517c5af admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:06.953384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae7acd-0f21-404d-bff1-09cb9857bdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:06.954035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae7acd-0f21-404d-bff1-09cb9857bdfb admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:06.954359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae7acd-0f21-404d-bff1-09cb9857bdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:06.954641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae7acd-0f21-404d-bff1-09cb9857bdfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:06.955348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae7acd-0f21-404d-bff1-09cb9857bdfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:06.957281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae7acd-0f21-404d-bff1-09cb9857bdfb admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:06.990943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded0eeba6dda4c32b62cd539396e59d8', 'request_id': 'req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:06.996379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded0eeba6dda4c32b62cd539396e59d8', 'request_id': 'req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:07.076438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded0eeba6dda4c32b62cd539396e59d8', 'request_id': 'req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:07.088735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1005/1993] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:06 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:07.093180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae7acd-0f21-404d-bff1-09cb9857bdfb admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.096809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] The token cache is being invalidate because project ded0eeba6dda4c32b62cd539396e59d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:07.096809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:07.098111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-edfe49e1-bf89-4cc3-a8cc-aede3d11a6e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:07.104511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 989/1994] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:06 2022] DELETE /identity/v3/projects/ded0eeba6dda4c32b62cd539396e59d8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:07.110401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27920a9a-e79a-4080-949e-6ca24dacdd81 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.110705 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27920a9a-e79a-4080-949e-6ca24dacdd81 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.110986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27920a9a-e79a-4080-949e-6ca24dacdd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.130397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-27920a9a-e79a-4080-949e-6ca24dacdd81 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:07.131708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-27920a9a-e79a-4080-949e-6ca24dacdd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:07.168541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae7acd-0f21-404d-bff1-09cb9857bdfb admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.173418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447cff5-b048-4df8-aa8f-05267b22eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.174092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447cff5-b048-4df8-aa8f-05267b22eff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.174443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447cff5-b048-4df8-aa8f-05267b22eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.175276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447cff5-b048-4df8-aa8f-05267b22eff6 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.175976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447cff5-b048-4df8-aa8f-05267b22eff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.177924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447cff5-b048-4df8-aa8f-05267b22eff6 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.188808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 990/1995] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:07.196326 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df517e-1980-4d0f-90da-0960795a0040 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.196610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df517e-1980-4d0f-90da-0960795a0040 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.199596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df517e-1980-4d0f-90da-0960795a0040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.218907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a7df517e-1980-4d0f-90da-0960795a0040 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:07.220167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a7df517e-1980-4d0f-90da-0960795a0040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:07.229356 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 991/1996] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:07.233389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df517e-1980-4d0f-90da-0960795a0040 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.242768 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df517e-1980-4d0f-90da-0960795a0040 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.247488 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c999-36c0-4b78-9504-0a2ba4547c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.248114 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c999-36c0-4b78-9504-0a2ba4547c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.248396 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c999-36c0-4b78-9504-0a2ba4547c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.248672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78c999-36c0-4b78-9504-0a2ba4547c15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.249389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78c999-36c0-4b78-9504-0a2ba4547c15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:07.249695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78c999-36c0-4b78-9504-0a2ba4547c15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.251332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78c999-36c0-4b78-9504-0a2ba4547c15 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.262571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 992/1997] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:28:07.266711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c999-36c0-4b78-9504-0a2ba4547c15 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.270929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1006/1998] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:07 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:07.274632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447cff5-b048-4df8-aa8f-05267b22eff6 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.276133 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78c999-36c0-4b78-9504-0a2ba4547c15 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.276346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b447cff5-b048-4df8-aa8f-05267b22eff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:07.280955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe63d1f-92f9-4095-9265-3887afc10aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.281591 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63d1f-92f9-4095-9265-3887afc10aab admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.281876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63d1f-92f9-4095-9265-3887afc10aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.282151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63d1f-92f9-4095-9265-3887afc10aab admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.282830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe63d1f-92f9-4095-9265-3887afc10aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.285381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe63d1f-92f9-4095-9265-3887afc10aab admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.289106 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447cff5-b048-4df8-aa8f-05267b22eff6 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.293807 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bce41e-86b2-4fcc-89d2-85b71521ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.294468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bce41e-86b2-4fcc-89d2-85b71521ea27 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.294756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bce41e-86b2-4fcc-89d2-85b71521ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.295037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bce41e-86b2-4fcc-89d2-85b71521ea27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.295800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bce41e-86b2-4fcc-89d2-85b71521ea27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.297412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bce41e-86b2-4fcc-89d2-85b71521ea27 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.308001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1007/1999] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:07.313088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bce41e-86b2-4fcc-89d2-85b71521ea27 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.321429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bce41e-86b2-4fcc-89d2-85b71521ea27 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.326166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfd6ca-2364-4bab-9b04-f6cfb235ac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.326801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfd6ca-2364-4bab-9b04-f6cfb235ac28 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.327092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfd6ca-2364-4bab-9b04-f6cfb235ac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.327426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfd6ca-2364-4bab-9b04-f6cfb235ac28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.328138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfd6ca-2364-4bab-9b04-f6cfb235ac28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.329717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfd6ca-2364-4bab-9b04-f6cfb235ac28 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.340925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1008/2000] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:07.345128 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfd6ca-2364-4bab-9b04-f6cfb235ac28 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.355024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfd6ca-2364-4bab-9b04-f6cfb235ac28 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.360422 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 993/2001] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:07 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:07.360552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd2c08-018b-4a15-b5dd-810ef16bdb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.368043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2c08-018b-4a15-b5dd-810ef16bdb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.368043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2c08-018b-4a15-b5dd-810ef16bdb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.368043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2c08-018b-4a15-b5dd-810ef16bdb06 admin admin] PATH_INFO: `/v3/projects/b7e7bfaa9b5c4be1996fe3f5e20037bd/users/4bde662e95ab4528a222c52f24719bb5/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.368287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe63d1f-92f9-4095-9265-3887afc10aab admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.376601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd2c08-018b-4a15-b5dd-810ef16bdb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e7bfaa9b5c4be1996fe3f5e20037bd, user_id=4bde662e95ab4528a222c52f24719bb5, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.379586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd2c08-018b-4a15-b5dd-810ef16bdb06 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.434224 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe63d1f-92f9-4095-9265-3887afc10aab admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.438909 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037ad3b-a574-4409-8589-d1ef6ab5df2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.439541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037ad3b-a574-4409-8589-d1ef6ab5df2b admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.439820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037ad3b-a574-4409-8589-d1ef6ab5df2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.440125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037ad3b-a574-4409-8589-d1ef6ab5df2b admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.440808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037ad3b-a574-4409-8589-d1ef6ab5df2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.442742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037ad3b-a574-4409-8589-d1ef6ab5df2b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.447760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1009/2002] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:07 2022] PUT /identity/v3/projects/b7e7bfaa9b5c4be1996fe3f5e20037bd/users/4bde662e95ab4528a222c52f24719bb5/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:07.459251 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01a37-657e-4293-9bb7-acfee4b5eefc None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.459544 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01a37-657e-4293-9bb7-acfee4b5eefc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.459822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01a37-657e-4293-9bb7-acfee4b5eefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.485442 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-19e01a37-657e-4293-9bb7-acfee4b5eefc None None] MFA Rules not processed for user `4bde662e95ab4528a222c52f24719bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:07.486671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-19e01a37-657e-4293-9bb7-acfee4b5eefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:07.544728 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 994/2003] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:07 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:07.548745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037ad3b-a574-4409-8589-d1ef6ab5df2b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.551230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1010/2004] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:07.558880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01a37-657e-4293-9bb7-acfee4b5eefc None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.559682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037ad3b-a574-4409-8589-d1ef6ab5df2b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.616125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509730c-ee95-42b6-8383-c6addf7bc441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.616803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509730c-ee95-42b6-8383-c6addf7bc441 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.617087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509730c-ee95-42b6-8383-c6addf7bc441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.617362 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509730c-ee95-42b6-8383-c6addf7bc441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.618082 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509730c-ee95-42b6-8383-c6addf7bc441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.619155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01a37-657e-4293-9bb7-acfee4b5eefc None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.620406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509730c-ee95-42b6-8383-c6addf7bc441 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.624018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8078651-998d-4c3a-aca1-eb20f61321f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.624675 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8078651-998d-4c3a-aca1-eb20f61321f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.624967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8078651-998d-4c3a-aca1-eb20f61321f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.625250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8078651-998d-4c3a-aca1-eb20f61321f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.625950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8078651-998d-4c3a-aca1-eb20f61321f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.627911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8078651-998d-4c3a-aca1-eb20f61321f5 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.630181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 995/2005] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:07.634043 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509730c-ee95-42b6-8383-c6addf7bc441 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.643816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509730c-ee95-42b6-8383-c6addf7bc441 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.648318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08847b65-0b79-431b-b18d-54576226508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.648950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08847b65-0b79-431b-b18d-54576226508e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.649227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08847b65-0b79-431b-b18d-54576226508e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.649499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08847b65-0b79-431b-b18d-54576226508e admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.650197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08847b65-0b79-431b-b18d-54576226508e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.651828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08847b65-0b79-431b-b18d-54576226508e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.662257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 996/2006] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:07.666187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08847b65-0b79-431b-b18d-54576226508e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.676331 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08847b65-0b79-431b-b18d-54576226508e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.681068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f035c1-456f-4706-ae51-418c8928778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.681930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f035c1-456f-4706-ae51-418c8928778d admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.682217 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f035c1-456f-4706-ae51-418c8928778d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.682497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f035c1-456f-4706-ae51-418c8928778d admin admin] PATH_INFO: `/v3/projects/0a6514f2671c4c7f8f9b9c574d0e22c6/users/a93faefc3b9a4610a3d20b82650fe724/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.700510 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1011/2007] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:07 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:07.700690 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f035c1-456f-4706-ae51-418c8928778d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6514f2671c4c7f8f9b9c574d0e22c6, user_id=a93faefc3b9a4610a3d20b82650fe724, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.700789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8078651-998d-4c3a-aca1-eb20f61321f5 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.700876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f035c1-456f-4706-ae51-418c8928778d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.763212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8078651-998d-4c3a-aca1-eb20f61321f5 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.763359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 997/2008] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:07 2022] PUT /identity/v3/projects/0a6514f2671c4c7f8f9b9c574d0e22c6/users/a93faefc3b9a4610a3d20b82650fe724/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:07.774629 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11444717-a2bb-4419-b5b3-820e4a4ec486 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.775204 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11444717-a2bb-4419-b5b3-820e4a4ec486 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.777013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11444717-a2bb-4419-b5b3-820e4a4ec486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.805757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-11444717-a2bb-4419-b5b3-820e4a4ec486 None None] MFA Rules not processed for user `a93faefc3b9a4610a3d20b82650fe724`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:07.807097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-11444717-a2bb-4419-b5b3-820e4a4ec486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:07.841993 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217874c3-9657-43a3-a6c9-4567b227a3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.843995 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217874c3-9657-43a3-a6c9-4567b227a3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.844312 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217874c3-9657-43a3-a6c9-4567b227a3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.844594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217874c3-9657-43a3-a6c9-4567b227a3c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.845291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217874c3-9657-43a3-a6c9-4567b227a3c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.848055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217874c3-9657-43a3-a6c9-4567b227a3c2 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.874543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 998/2009] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:07.879396 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11444717-a2bb-4419-b5b3-820e4a4ec486 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.890446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11444717-a2bb-4419-b5b3-820e4a4ec486 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.895716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9700-586c-4ac4-b8ad-43bfc53574ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.896363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9700-586c-4ac4-b8ad-43bfc53574ec admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.902510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9700-586c-4ac4-b8ad-43bfc53574ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.902510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9700-586c-4ac4-b8ad-43bfc53574ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.902510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb9700-586c-4ac4-b8ad-43bfc53574ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.902510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb9700-586c-4ac4-b8ad-43bfc53574ec admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.933603 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1012/2010] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:07 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:07.937527 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217874c3-9657-43a3-a6c9-4567b227a3c2 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.947338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217874c3-9657-43a3-a6c9-4567b227a3c2 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.951912 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaf55e-3693-471c-94b4-6caf1256f5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.952482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf55e-3693-471c-94b4-6caf1256f5cc admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.952759 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf55e-3693-471c-94b4-6caf1256f5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.953028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf55e-3693-471c-94b4-6caf1256f5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:07.953731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aaf55e-3693-471c-94b4-6caf1256f5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:07.955361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aaf55e-3693-471c-94b4-6caf1256f5cc admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:07.965766 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1013/2011] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:07.970061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaf55e-3693-471c-94b4-6caf1256f5cc admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:07.979605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaf55e-3693-471c-94b4-6caf1256f5cc admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:07.984385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d20f-cde2-4126-8182-ccd42e9d4c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:07.985230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d20f-cde2-4126-8182-ccd42e9d4c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:07.985514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d20f-cde2-4126-8182-ccd42e9d4c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:07.985786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d20f-cde2-4126-8182-ccd42e9d4c2e admin admin] PATH_INFO: `/v3/projects/840cad1c099f4e0fb88d599c6c266d68/users/06655e356a5740f796929c312d7eb747/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.001138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 999/2012] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:07 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:08.001691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d20f-cde2-4126-8182-ccd42e9d4c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=840cad1c099f4e0fb88d599c6c266d68, user_id=06655e356a5740f796929c312d7eb747, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:08.002230 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9700-586c-4ac4-b8ad-43bfc53574ec admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:08.005055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d20f-cde2-4126-8182-ccd42e9d4c2e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:08.062455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9700-586c-4ac4-b8ad-43bfc53574ec admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:08.067676 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9eb12-4326-45ac-ac4a-387b15f861bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:08.068394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9eb12-4326-45ac-ac4a-387b15f861bf admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.068677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9eb12-4326-45ac-ac4a-387b15f861bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.068993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9eb12-4326-45ac-ac4a-387b15f861bf admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.069672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9eb12-4326-45ac-ac4a-387b15f861bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:08.071577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1014/2013] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:07 2022] PUT /identity/v3/projects/840cad1c099f4e0fb88d599c6c266d68/users/06655e356a5740f796929c312d7eb747/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:08.071700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9eb12-4326-45ac-ac4a-387b15f861bf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:08.075385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d20f-cde2-4126-8182-ccd42e9d4c2e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:08.141654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d20f-cde2-4126-8182-ccd42e9d4c2e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:08.147237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b56b07-de29-4c37-80fc-ebb11db5646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:08.147914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b56b07-de29-4c37-80fc-ebb11db5646e admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.148199 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b56b07-de29-4c37-80fc-ebb11db5646e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.148492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b56b07-de29-4c37-80fc-ebb11db5646e admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.149216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b56b07-de29-4c37-80fc-ebb11db5646e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:08.150832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b56b07-de29-4c37-80fc-ebb11db5646e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:08.153161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1000/2014] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:08 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:08.157338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9eb12-4326-45ac-ac4a-387b15f861bf admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:08.165167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1015/2015] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:08.166222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b56b07-de29-4c37-80fc-ebb11db5646e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:08.168133 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9eb12-4326-45ac-ac4a-387b15f861bf admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:08.172832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932a43b-f802-46e0-b61a-858cbe23708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:08.173518 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932a43b-f802-46e0-b61a-858cbe23708e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.173799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932a43b-f802-46e0-b61a-858cbe23708e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.174075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932a43b-f802-46e0-b61a-858cbe23708e admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.175368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932a43b-f802-46e0-b61a-858cbe23708e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:08.176453 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b56b07-de29-4c37-80fc-ebb11db5646e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:08.177294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932a43b-f802-46e0-b61a-858cbe23708e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:08.187424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1001/2016] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:08.191808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932a43b-f802-46e0-b61a-858cbe23708e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:08.192653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f30c0f-9671-4b95-9229-211f11f698bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:08.193592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30c0f-9671-4b95-9229-211f11f698bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.193928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30c0f-9671-4b95-9229-211f11f698bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.194207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30c0f-9671-4b95-9229-211f11f698bb admin admin] PATH_INFO: `/v3/projects/840cad1c099f4e0fb88d599c6c266d68/users/06655e356a5740f796929c312d7eb747/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.196338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f30c0f-9671-4b95-9229-211f11f698bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=840cad1c099f4e0fb88d599c6c266d68, user_id=06655e356a5740f796929c312d7eb747, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:08.199037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f30c0f-9671-4b95-9229-211f11f698bb admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:08.201739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932a43b-f802-46e0-b61a-858cbe23708e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:08.206592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9aecf-229e-4ad3-ac25-992abf89997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:08.207430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aecf-229e-4ad3-ac25-992abf89997a admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.207715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aecf-229e-4ad3-ac25-992abf89997a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.207992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aecf-229e-4ad3-ac25-992abf89997a admin admin] PATH_INFO: `/v3/projects/33e3e3a4af624bdf813068daa4fb06d6/users/b35670d431664703bf92e498cd04a8a3/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.209142 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1016/2017] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:08 2022] PUT /identity/v3/projects/840cad1c099f4e0fb88d599c6c266d68/users/06655e356a5740f796929c312d7eb747/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:08.219405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77fcd5-00c7-47c2-bf6a-08ee4f149800 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.219696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77fcd5-00c7-47c2-bf6a-08ee4f149800 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.220093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77fcd5-00c7-47c2-bf6a-08ee4f149800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.225305 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9aecf-229e-4ad3-ac25-992abf89997a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e3e3a4af624bdf813068daa4fb06d6, user_id=b35670d431664703bf92e498cd04a8a3, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:08.228046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9aecf-229e-4ad3-ac25-992abf89997a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:08.246451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-ec77fcd5-00c7-47c2-bf6a-08ee4f149800 None None] MFA Rules not processed for user `06655e356a5740f796929c312d7eb747`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:08.247759 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ec77fcd5-00c7-47c2-bf6a-08ee4f149800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:08.293313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1002/2018] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:08 2022] PUT /identity/v3/projects/33e3e3a4af624bdf813068daa4fb06d6/users/b35670d431664703bf92e498cd04a8a3/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:08.297146 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9aecf-229e-4ad3-ac25-992abf89997a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:08.313521 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1017/2019] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:08.326275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77fcd5-00c7-47c2-bf6a-08ee4f149800 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:08.327660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ec77fcd5-00c7-47c2-bf6a-08ee4f149800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:08.358731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9aecf-229e-4ad3-ac25-992abf89997a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:08.364175 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858ab19-6740-4077-8a74-82879fe7d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:08.364845 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858ab19-6740-4077-8a74-82879fe7d180 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.365127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858ab19-6740-4077-8a74-82879fe7d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.365411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858ab19-6740-4077-8a74-82879fe7d180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.366125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858ab19-6740-4077-8a74-82879fe7d180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:08.367834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858ab19-6740-4077-8a74-82879fe7d180 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:08.381103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1003/2020] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:08.382166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858ab19-6740-4077-8a74-82879fe7d180 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:08.382651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77fcd5-00c7-47c2-bf6a-08ee4f149800 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:08.391554 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858ab19-6740-4077-8a74-82879fe7d180 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:08.396216 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c5f64-71a9-4d75-9ef1-e12eb377961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:08.397075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c5f64-71a9-4d75-9ef1-e12eb377961d admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.397359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c5f64-71a9-4d75-9ef1-e12eb377961d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.397637 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c5f64-71a9-4d75-9ef1-e12eb377961d admin admin] PATH_INFO: `/v3/projects/33e3e3a4af624bdf813068daa4fb06d6/users/b35670d431664703bf92e498cd04a8a3/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.399744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c5f64-71a9-4d75-9ef1-e12eb377961d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e3e3a4af624bdf813068daa4fb06d6, user_id=b35670d431664703bf92e498cd04a8a3, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:08.402429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c5f64-71a9-4d75-9ef1-e12eb377961d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:08.412750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1004/2021] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:08 2022] PUT /identity/v3/projects/33e3e3a4af624bdf813068daa4fb06d6/users/b35670d431664703bf92e498cd04a8a3/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:08.422658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601fddb-bb00-470a-8f71-a093a666049e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.422947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601fddb-bb00-470a-8f71-a093a666049e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.423379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601fddb-bb00-470a-8f71-a093a666049e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.433800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902417c-168c-4966-9f5f-b98c4e78f75b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:08.434461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902417c-168c-4966-9f5f-b98c4e78f75b service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.434754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902417c-168c-4966-9f5f-b98c4e78f75b service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.435028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902417c-168c-4966-9f5f-b98c4e78f75b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.451320 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0601fddb-bb00-470a-8f71-a093a666049e None None] MFA Rules not processed for user `b35670d431664703bf92e498cd04a8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:08.452551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0601fddb-bb00-470a-8f71-a093a666049e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:08.494697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902417c-168c-4966-9f5f-b98c4e78f75b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:08.496142 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902417c-168c-4966-9f5f-b98c4e78f75b service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:08.506321 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1018/2022] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:08.519933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1005/2023] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:08.531423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902417c-168c-4966-9f5f-b98c4e78f75b service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:08.532877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3902417c-168c-4966-9f5f-b98c4e78f75b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:08.544425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902417c-168c-4966-9f5f-b98c4e78f75b service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:08.592966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e1f0e-abea-4778-b172-83a9af097936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:08.593937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e1f0e-abea-4778-b172-83a9af097936 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.594224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e1f0e-abea-4778-b172-83a9af097936 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.598281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e1f0e-abea-4778-b172-83a9af097936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.604363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e1f0e-abea-4778-b172-83a9af097936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:08.605816 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e1f0e-abea-4778-b172-83a9af097936 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:08.615823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1019/2024] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:08.755181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601fddb-bb00-470a-8f71-a093a666049e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:08.773391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601fddb-bb00-470a-8f71-a093a666049e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:08.773391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6909b1-31e6-46dc-8624-4970bd8fc5d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:08.773391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6909b1-31e6-46dc-8624-4970bd8fc5d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:08.773391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6909b1-31e6-46dc-8624-4970bd8fc5d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:08.773774 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6909b1-31e6-46dc-8624-4970bd8fc5d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:08.823584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6909b1-31e6-46dc-8624-4970bd8fc5d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:08.825032 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6909b1-31e6-46dc-8624-4970bd8fc5d0 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:08.833735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1006/2025] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:09.390120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e1f0e-abea-4778-b172-83a9af097936 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:09.440773 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6909b1-31e6-46dc-8624-4970bd8fc5d0 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:09.455944 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e1f0e-abea-4778-b172-83a9af097936 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:09.460489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:09.461358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:09.461641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:09.461913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] PATH_INFO: `/v3/users/a93faefc3b9a4610a3d20b82650fe724` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:09.463108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a93faefc3b9a4610a3d20b82650fe724)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:09.465070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:09.500652 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6909b1-31e6-46dc-8624-4970bd8fc5d0 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:09.505177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348978f5-aa0f-41e4-8d0b-18e451859d02 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06655e356a5740f796929c312d7eb747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '840cad1c099f4e0fb88d599c6c266d68', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:09.505835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348978f5-aa0f-41e4-8d0b-18e451859d02 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:09.506120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348978f5-aa0f-41e4-8d0b-18e451859d02 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:09.507722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348978f5-aa0f-41e4-8d0b-18e451859d02 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:09.507722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348978f5-aa0f-41e4-8d0b-18e451859d02 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:09.507722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348978f5-aa0f-41e4-8d0b-18e451859d02 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:09.509179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348978f5-aa0f-41e4-8d0b-18e451859d02 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:09.520254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1007/2026] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:28:09.524201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348978f5-aa0f-41e4-8d0b-18e451859d02 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:09.533344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348978f5-aa0f-41e4-8d0b-18e451859d02 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:09.538369 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d8eb8-3612-4166-9d8a-1568c389e8cc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06655e356a5740f796929c312d7eb747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '840cad1c099f4e0fb88d599c6c266d68', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:09.539006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d8eb8-3612-4166-9d8a-1568c389e8cc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:09.539324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d8eb8-3612-4166-9d8a-1568c389e8cc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:09.539607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d8eb8-3612-4166-9d8a-1568c389e8cc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:09.540275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d8eb8-3612-4166-9d8a-1568c389e8cc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:09.542149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d8eb8-3612-4166-9d8a-1568c389e8cc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:09.661238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1008/2027] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:09 2022] POST /identity/v3/projects => generated 354 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:09.665088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d8eb8-3612-4166-9d8a-1568c389e8cc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:09.684334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a93faefc3b9a4610a3d20b82650fe724'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:09.695799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a93faefc3b9a4610a3d20b82650fe724'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:09.696488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a93faefc3b9a4610a3d20b82650fe724'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:09.726892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d8eb8-3612-4166-9d8a-1568c389e8cc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:09.731590 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcb73d-0f98-412e-8510-ccf5be8fa0dc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06655e356a5740f796929c312d7eb747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '840cad1c099f4e0fb88d599c6c266d68', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:09.732251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb73d-0f98-412e-8510-ccf5be8fa0dc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:09.732533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb73d-0f98-412e-8510-ccf5be8fa0dc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:09.732812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb73d-0f98-412e-8510-ccf5be8fa0dc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:09.733531 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcb73d-0f98-412e-8510-ccf5be8fa0dc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:09.733836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcb73d-0f98-412e-8510-ccf5be8fa0dc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:09.735472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcb73d-0f98-412e-8510-ccf5be8fa0dc tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:09.755042 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1009/2028] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:28:09.767728 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a93faefc3b9a4610a3d20b82650fe724'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:09.775514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a93faefc3b9a4610a3d20b82650fe724'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:09.781684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1020/2029] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:09 2022] DELETE /identity/v3/users/a93faefc3b9a4610a3d20b82650fe724 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:09.790606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044723-504a-4083-8ca5-ada627965cec None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:09.791063 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044723-504a-4083-8ca5-ada627965cec None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:09.791404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044723-504a-4083-8ca5-ada627965cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:09.792585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:09.794104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:09.809291 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-08044723-504a-4083-8ca5-ada627965cec None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:09.810767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-08044723-504a-4083-8ca5-ada627965cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:09.858172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bc02b-fec7-48a2-b31f-256531eaa600 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:09.862892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06655e356a5740f796929c312d7eb747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '840cad1c099f4e0fb88d599c6c266d68', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:09.864473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:09.864473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:09.864473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] PATH_INFO: `/v3/projects/6298994339f84cdc81920b86633f5ea6` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:09.865699 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6298994339f84cdc81920b86633f5ea6)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:09.867676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:09.868851 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1010/2030] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:09.878723 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08044723-504a-4083-8ca5-ada627965cec None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:09.880105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-08044723-504a-4083-8ca5-ada627965cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:09.937098 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08044723-504a-4083-8ca5-ada627965cec None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:09.940661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ada37-d394-4ae4-b5e5-e9996f2ff7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:09.941304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ada37-d394-4ae4-b5e5-e9996f2ff7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:09.941588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ada37-d394-4ae4-b5e5-e9996f2ff7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:09.941865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ada37-d394-4ae4-b5e5-e9996f2ff7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:09.950927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ada37-d394-4ae4-b5e5-e9996f2ff7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:09.952414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ada37-d394-4ae4-b5e5-e9996f2ff7d3 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:09.962338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1011/2031] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:09.978331 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6298994339f84cdc81920b86633f5ea6', 'request_id': 'req-9ba6be2b-153f-4b30-ba18-06b54f24de65'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:09.983976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6298994339f84cdc81920b86633f5ea6', 'request_id': 'req-9ba6be2b-153f-4b30-ba18-06b54f24de65'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:10.064773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6298994339f84cdc81920b86633f5ea6', 'request_id': 'req-9ba6be2b-153f-4b30-ba18-06b54f24de65'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:10.077130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] The token cache is being invalidate because project 6298994339f84cdc81920b86633f5ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:10.077425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:10.078100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:10.079774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1021/2032] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:09 2022] DELETE /identity/v3/projects/6298994339f84cdc81920b86633f5ea6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:10.420620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ada37-d394-4ae4-b5e5-e9996f2ff7d3 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:10.422058 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-843ada37-d394-4ae4-b5e5-e9996f2ff7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:10.435811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ada37-d394-4ae4-b5e5-e9996f2ff7d3 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:10.491511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:10.492372 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:10.492652 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:10.492923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] PATH_INFO: `/v3/projects/0a6514f2671c4c7f8f9b9c574d0e22c6` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:10.494084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6514f2671c4c7f8f9b9c574d0e22c6)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:10.496044 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:10.626786 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6514f2671c4c7f8f9b9c574d0e22c6', 'request_id': 'req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:10.632398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6514f2671c4c7f8f9b9c574d0e22c6', 'request_id': 'req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:10.699107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6514f2671c4c7f8f9b9c574d0e22c6', 'request_id': 'req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:10.711000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] The token cache is being invalidate because project 0a6514f2671c4c7f8f9b9c574d0e22c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:10.711315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:10.711939 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:10.713481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1012/2033] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:10 2022] DELETE /identity/v3/projects/0a6514f2671c4c7f8f9b9c574d0e22c6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:10.717896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:10.719611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:10.734532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6be2b-153f-4b30-ba18-06b54f24de65 tempest-VolumeQuotaClassesTest-1926823206 tempest-VolumeQuotaClassesTest-1926823206-project-admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:10.736718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:10.738132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:10.790266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7eb42-af4c-4b23-bed7-86991a006077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:10.791231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7eb42-af4c-4b23-bed7-86991a006077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:10.791515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7eb42-af4c-4b23-bed7-86991a006077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:10.791793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7eb42-af4c-4b23-bed7-86991a006077 admin admin] PATH_INFO: `/v3/users/b35670d431664703bf92e498cd04a8a3` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:10.792996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7eb42-af4c-4b23-bed7-86991a006077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35670d431664703bf92e498cd04a8a3)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:10.794976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7eb42-af4c-4b23-bed7-86991a006077 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:10.800360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf678-73cd-4ec5-9b6c-08cd18bc7c23 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:10.805416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:10.806345 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:10.806635 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:10.806913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] PATH_INFO: `/v3/users/4bde662e95ab4528a222c52f24719bb5` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:10.808147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bde662e95ab4528a222c52f24719bb5)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:10.810092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:11.083609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-33e7eb42-af4c-4b23-bed7-86991a006077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35670d431664703bf92e498cd04a8a3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.095347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-33e7eb42-af4c-4b23-bed7-86991a006077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35670d431664703bf92e498cd04a8a3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.096013 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-33e7eb42-af4c-4b23-bed7-86991a006077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35670d431664703bf92e498cd04a8a3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.114461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bde662e95ab4528a222c52f24719bb5'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.125753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bde662e95ab4528a222c52f24719bb5'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.133206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bde662e95ab4528a222c52f24719bb5'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.133882 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bde662e95ab4528a222c52f24719bb5'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.190919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-33e7eb42-af4c-4b23-bed7-86991a006077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35670d431664703bf92e498cd04a8a3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.200550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-33e7eb42-af4c-4b23-bed7-86991a006077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35670d431664703bf92e498cd04a8a3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.206437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1022/2034] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:10 2022] DELETE /identity/v3/users/b35670d431664703bf92e498cd04a8a3 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:11.279450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bde662e95ab4528a222c52f24719bb5'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.287873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1013/2035] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:10 2022] DELETE /identity/v3/users/4bde662e95ab4528a222c52f24719bb5 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:11.295791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89835ab-9d7c-4582-aa87-51b9751d21b2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:11.296093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89835ab-9d7c-4582-aa87-51b9751d21b2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:11.296377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89835ab-9d7c-4582-aa87-51b9751d21b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:11.325399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-c89835ab-9d7c-4582-aa87-51b9751d21b2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:11.327007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c89835ab-9d7c-4582-aa87-51b9751d21b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:11.442450 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1023/2036] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:11.452315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:11.453819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:11.513281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c45b4-198a-4d63-8e88-a1a25e29f102 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:11.516832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64321f-c62f-4c55-b4b5-f2a1326d890f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:11.517477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64321f-c62f-4c55-b4b5-f2a1326d890f service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:11.517756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64321f-c62f-4c55-b4b5-f2a1326d890f service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:11.518030 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64321f-c62f-4c55-b4b5-f2a1326d890f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:11.527537 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64321f-c62f-4c55-b4b5-f2a1326d890f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:11.528988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64321f-c62f-4c55-b4b5-f2a1326d890f service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:11.538572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1014/2037] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:11.678439 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89835ab-9d7c-4582-aa87-51b9751d21b2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:11.679913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c89835ab-9d7c-4582-aa87-51b9751d21b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:11.694066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89835ab-9d7c-4582-aa87-51b9751d21b2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:11.699414 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:11.700432 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:11.700778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:11.701158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] PATH_INFO: `/v3/projects/33e3e3a4af624bdf813068daa4fb06d6` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:11.702685 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e3e3a4af624bdf813068daa4fb06d6)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:11.704901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:11.822731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e3e3a4af624bdf813068daa4fb06d6', 'request_id': 'req-f67d2b5e-7591-473b-964f-0da8d43c7323'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.828371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e3e3a4af624bdf813068daa4fb06d6', 'request_id': 'req-f67d2b5e-7591-473b-964f-0da8d43c7323'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.887676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e3e3a4af624bdf813068daa4fb06d6', 'request_id': 'req-f67d2b5e-7591-473b-964f-0da8d43c7323'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.903360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] The token cache is being invalidate because project 33e3e3a4af624bdf813068daa4fb06d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:11.903884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.904731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f67d2b5e-7591-473b-964f-0da8d43c7323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:11.910794 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1024/2038] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:11 2022] DELETE /identity/v3/projects/33e3e3a4af624bdf813068daa4fb06d6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:11.912344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9b5d3-e58a-4954-b446-f04ed08ed220 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:11.912685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9b5d3-e58a-4954-b446-f04ed08ed220 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:11.912969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9b5d3-e58a-4954-b446-f04ed08ed220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:11.931914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a9c9b5d3-e58a-4954-b446-f04ed08ed220 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:11.933161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a9c9b5d3-e58a-4954-b446-f04ed08ed220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:12.011274 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1015/2039] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:12.019637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ff2f5-da00-4de1-be1e-c7f6bb0b99f4 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:12.019934 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ff2f5-da00-4de1-be1e-c7f6bb0b99f4 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:12.020254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ff2f5-da00-4de1-be1e-c7f6bb0b99f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:12.039447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-098ff2f5-da00-4de1-be1e-c7f6bb0b99f4 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:12.040622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-098ff2f5-da00-4de1-be1e-c7f6bb0b99f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:12.048572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1025/2040] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:12.053419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9b5d3-e58a-4954-b446-f04ed08ed220 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:12.068754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9b5d3-e58a-4954-b446-f04ed08ed220 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:12.073592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475332b3-efdd-4256-9b40-c73a6416b71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:12.074264 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475332b3-efdd-4256-9b40-c73a6416b71f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:12.074551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475332b3-efdd-4256-9b40-c73a6416b71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:12.074879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475332b3-efdd-4256-9b40-c73a6416b71f admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:12.075889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475332b3-efdd-4256-9b40-c73a6416b71f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:12.076018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475332b3-efdd-4256-9b40-c73a6416b71f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:12.077595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475332b3-efdd-4256-9b40-c73a6416b71f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:12.090562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1016/2041] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:28:12.095389 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ff2f5-da00-4de1-be1e-c7f6bb0b99f4 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:12.105110 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ff2f5-da00-4de1-be1e-c7f6bb0b99f4 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:12.109902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79423-4a3a-4ad0-98a4-cb4541b60600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:12.111818 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79423-4a3a-4ad0-98a4-cb4541b60600 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:12.111818 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79423-4a3a-4ad0-98a4-cb4541b60600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:12.111818 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79423-4a3a-4ad0-98a4-cb4541b60600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:12.111818 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d79423-4a3a-4ad0-98a4-cb4541b60600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:12.113824 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d79423-4a3a-4ad0-98a4-cb4541b60600 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:12.221616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475332b3-efdd-4256-9b40-c73a6416b71f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:12.224600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-475332b3-efdd-4256-9b40-c73a6416b71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:12.239243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1026/2042] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:12 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:12.239687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475332b3-efdd-4256-9b40-c73a6416b71f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:12.243009 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79423-4a3a-4ad0-98a4-cb4541b60600 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:12.296993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:12.297812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:12.298105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:12.298403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] PATH_INFO: `/v3/projects/b7e7bfaa9b5c4be1996fe3f5e20037bd` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:12.299680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e7bfaa9b5c4be1996fe3f5e20037bd)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:12.301759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:12.311501 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79423-4a3a-4ad0-98a4-cb4541b60600 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:12.316787 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcb05e-9f6a-4e27-aa03-f833ec0fbda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:12.317446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcb05e-9f6a-4e27-aa03-f833ec0fbda4 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:12.317727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcb05e-9f6a-4e27-aa03-f833ec0fbda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:12.318003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcb05e-9f6a-4e27-aa03-f833ec0fbda4 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:12.318688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcb05e-9f6a-4e27-aa03-f833ec0fbda4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:12.320664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcb05e-9f6a-4e27-aa03-f833ec0fbda4 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:12.419466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e7bfaa9b5c4be1996fe3f5e20037bd', 'request_id': 'req-d6b1a976-203b-4e8f-ae57-676d05b9027b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:12.424898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e7bfaa9b5c4be1996fe3f5e20037bd', 'request_id': 'req-d6b1a976-203b-4e8f-ae57-676d05b9027b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:12.447875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1027/2043] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:12 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:12.453100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcb05e-9f6a-4e27-aa03-f833ec0fbda4 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:12.462450 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcb05e-9f6a-4e27-aa03-f833ec0fbda4 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:12.504522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e7bfaa9b5c4be1996fe3f5e20037bd', 'request_id': 'req-d6b1a976-203b-4e8f-ae57-676d05b9027b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:12.519069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] The token cache is being invalidate because project b7e7bfaa9b5c4be1996fe3f5e20037bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:12.519675 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45998558-f95f-4c85-a46b-465f1d6bd03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:12.520118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:12.520302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45998558-f95f-4c85-a46b-465f1d6bd03a admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:12.520568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45998558-f95f-4c85-a46b-465f1d6bd03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:12.520912 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45998558-f95f-4c85-a46b-465f1d6bd03a admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:12.521020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:12.521654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45998558-f95f-4c85-a46b-465f1d6bd03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:12.522967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1017/2044] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:12 2022] DELETE /identity/v3/projects/b7e7bfaa9b5c4be1996fe3f5e20037bd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:12.526044 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45998558-f95f-4c85-a46b-465f1d6bd03a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:12.528168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:12.529596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:12.537595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1028/2045] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:12.542064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45998558-f95f-4c85-a46b-465f1d6bd03a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:12.542889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1a976-203b-4e8f-ae57-676d05b9027b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:12.543928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-45998558-f95f-4c85-a46b-465f1d6bd03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:12.548268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:12.549189 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:12.549469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:12.549744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] PATH_INFO: `/v3/users/06655e356a5740f796929c312d7eb747` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:12.551540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06655e356a5740f796929c312d7eb747)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:12.553485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:12.558778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45998558-f95f-4c85-a46b-465f1d6bd03a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:12.564207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b41551-c697-45bc-9813-652173c66401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:12.564961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41551-c697-45bc-9813-652173c66401 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:12.565427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41551-c697-45bc-9813-652173c66401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:12.565943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41551-c697-45bc-9813-652173c66401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:12.566758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b41551-c697-45bc-9813-652173c66401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:12.568481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b41551-c697-45bc-9813-652173c66401 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:12.579080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1029/2046] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:12.586817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b41551-c697-45bc-9813-652173c66401 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:12.596840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b41551-c697-45bc-9813-652173c66401 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:12.602172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac8729-8646-491d-a064-532cf950e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:12.603046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac8729-8646-491d-a064-532cf950e2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:12.603380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac8729-8646-491d-a064-532cf950e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:12.603660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac8729-8646-491d-a064-532cf950e2a8 admin admin] PATH_INFO: `/v3/projects/9137b47105484bd69fcd671f75694976/users/3a4deefc06e74462a2870456b53b58c9/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:12.618751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac8729-8646-491d-a064-532cf950e2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9137b47105484bd69fcd671f75694976, user_id=3a4deefc06e74462a2870456b53b58c9, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:12.621604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac8729-8646-491d-a064-532cf950e2a8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:12.728676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1030/2047] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:12 2022] PUT /identity/v3/projects/9137b47105484bd69fcd671f75694976/users/3a4deefc06e74462a2870456b53b58c9/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:12.739539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3f55-2cdd-4d25-8dcf-1278b9c88bef None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:12.739836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3f55-2cdd-4d25-8dcf-1278b9c88bef None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:12.740120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3f55-2cdd-4d25-8dcf-1278b9c88bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:12.764855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-03cf3f55-2cdd-4d25-8dcf-1278b9c88bef None None] MFA Rules not processed for user `3a4deefc06e74462a2870456b53b58c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:12.766071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-03cf3f55-2cdd-4d25-8dcf-1278b9c88bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:12.803198 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06655e356a5740f796929c312d7eb747'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:12.815665 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06655e356a5740f796929c312d7eb747'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:12.824198 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06655e356a5740f796929c312d7eb747'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:12.824913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06655e356a5740f796929c312d7eb747'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:12.835717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1031/2048] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:12.849273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf3f55-2cdd-4d25-8dcf-1278b9c88bef None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:12.850791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-03cf3f55-2cdd-4d25-8dcf-1278b9c88bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:12.887638 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06655e356a5740f796929c312d7eb747'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:12.894683 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1018/2049] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:12 2022] DELETE /identity/v3/users/06655e356a5740f796929c312d7eb747 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:12.907495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf3f55-2cdd-4d25-8dcf-1278b9c88bef None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:12.956414 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dd6bb-5060-437a-b6e5-b85595c34e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:12.957590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dd6bb-5060-437a-b6e5-b85595c34e21 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:12.957875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dd6bb-5060-437a-b6e5-b85595c34e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:12.958158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dd6bb-5060-437a-b6e5-b85595c34e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:12.960010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-512dd6bb-5060-437a-b6e5-b85595c34e21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:13.022931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dd6bb-5060-437a-b6e5-b85595c34e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:13.024434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dd6bb-5060-437a-b6e5-b85595c34e21 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:13.033937 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1032/2050] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:13.053391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:13.054766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:13.123362 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf91b0-e15f-4d73-a180-b471fead4a0f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:13.128172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450cbd3-b8f3-4b56-bd6a-6b7156d46dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:13.129583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450cbd3-b8f3-4b56-bd6a-6b7156d46dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:13.129864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450cbd3-b8f3-4b56-bd6a-6b7156d46dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:13.130135 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450cbd3-b8f3-4b56-bd6a-6b7156d46dfb admin admin] PATH_INFO: `/v3/users/3a4deefc06e74462a2870456b53b58c9` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:13.131406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450cbd3-b8f3-4b56-bd6a-6b7156d46dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4deefc06e74462a2870456b53b58c9)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:13.133552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450cbd3-b8f3-4b56-bd6a-6b7156d46dfb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:13.308127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9450cbd3-b8f3-4b56-bd6a-6b7156d46dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4deefc06e74462a2870456b53b58c9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:13.313392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dd6bb-5060-437a-b6e5-b85595c34e21 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:13.316552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-512dd6bb-5060-437a-b6e5-b85595c34e21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:13.325380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9450cbd3-b8f3-4b56-bd6a-6b7156d46dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4deefc06e74462a2870456b53b58c9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:13.332941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9450cbd3-b8f3-4b56-bd6a-6b7156d46dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4deefc06e74462a2870456b53b58c9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:13.333660 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9450cbd3-b8f3-4b56-bd6a-6b7156d46dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4deefc06e74462a2870456b53b58c9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:13.348217 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dd6bb-5060-437a-b6e5-b85595c34e21 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:13.352342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:13.353204 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:13.353490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:13.353764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] PATH_INFO: `/v3/projects/840cad1c099f4e0fb88d599c6c266d68` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:13.355008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=840cad1c099f4e0fb88d599c6c266d68)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:13.356986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:13.402627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9450cbd3-b8f3-4b56-bd6a-6b7156d46dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4deefc06e74462a2870456b53b58c9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:13.412913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1019/2051] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:13 2022] DELETE /identity/v3/users/3a4deefc06e74462a2870456b53b58c9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:13.418706 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21207d-2518-424d-853b-1490c1ef7d7b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:13.419004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21207d-2518-424d-853b-1490c1ef7d7b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:13.419358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21207d-2518-424d-853b-1490c1ef7d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:13.437688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3e21207d-2518-424d-853b-1490c1ef7d7b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:13.439213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3e21207d-2518-424d-853b-1490c1ef7d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:13.495822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840cad1c099f4e0fb88d599c6c266d68', 'request_id': 'req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:13.502540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840cad1c099f4e0fb88d599c6c266d68', 'request_id': 'req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:13.507385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1020/2052] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:13.516041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21207d-2518-424d-853b-1490c1ef7d7b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:13.517604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3e21207d-2518-424d-853b-1490c1ef7d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:13.551064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840cad1c099f4e0fb88d599c6c266d68', 'request_id': 'req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:13.563356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] The token cache is being invalidate because project 840cad1c099f4e0fb88d599c6c266d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:13.563614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:13.564593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-480d8bc9-0441-4a6c-9f8a-3347ab7368ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:13.566713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1033/2053] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:13 2022] DELETE /identity/v3/projects/840cad1c099f4e0fb88d599c6c266d68 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:13.572662 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399efdc2-9116-45a2-8911-e1f9e8ec2eb2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:13.572944 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399efdc2-9116-45a2-8911-e1f9e8ec2eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:13.573251 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399efdc2-9116-45a2-8911-e1f9e8ec2eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:13.579932 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21207d-2518-424d-853b-1490c1ef7d7b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:13.593081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-399efdc2-9116-45a2-8911-e1f9e8ec2eb2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:13.594682 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-399efdc2-9116-45a2-8911-e1f9e8ec2eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:13.635293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476552b-b0fa-426d-9231-90fc8997f0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:13.635955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476552b-b0fa-426d-9231-90fc8997f0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:13.636242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476552b-b0fa-426d-9231-90fc8997f0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:13.636518 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476552b-b0fa-426d-9231-90fc8997f0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:13.638421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e476552b-b0fa-426d-9231-90fc8997f0b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:13.669376 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1034/2054] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:13.677129 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eca42-d84a-462d-ab23-ffa58e258a01 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:13.677528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eca42-d84a-462d-ab23-ffa58e258a01 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:13.677919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eca42-d84a-462d-ab23-ffa58e258a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:13.698834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-916eca42-d84a-462d-ab23-ffa58e258a01 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:13.701520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-916eca42-d84a-462d-ab23-ffa58e258a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:13.704824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476552b-b0fa-426d-9231-90fc8997f0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:13.706464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476552b-b0fa-426d-9231-90fc8997f0b4 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:13.714183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1035/2055] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:13.715518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916eca42-d84a-462d-ab23-ffa58e258a01 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:13.718079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1021/2056] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:13.726023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916eca42-d84a-462d-ab23-ffa58e258a01 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:13.730757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482075b7-eee2-40ee-ba54-a2ab67e17332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:13.745237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482075b7-eee2-40ee-ba54-a2ab67e17332 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:13.745237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482075b7-eee2-40ee-ba54-a2ab67e17332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:13.745237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482075b7-eee2-40ee-ba54-a2ab67e17332 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:13.745237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482075b7-eee2-40ee-ba54-a2ab67e17332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:13.745237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482075b7-eee2-40ee-ba54-a2ab67e17332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:13.745237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482075b7-eee2-40ee-ba54-a2ab67e17332 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:13.746700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1036/2057] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:28:13.751147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476552b-b0fa-426d-9231-90fc8997f0b4 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:13.763361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476552b-b0fa-426d-9231-90fc8997f0b4 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:13.768172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3b26-9b21-424c-b27b-5f77cf6293f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:13.768802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3b26-9b21-424c-b27b-5f77cf6293f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:13.769124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3b26-9b21-424c-b27b-5f77cf6293f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:13.771203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3b26-9b21-424c-b27b-5f77cf6293f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:13.771203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb3b26-9b21-424c-b27b-5f77cf6293f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:13.772740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb3b26-9b21-424c-b27b-5f77cf6293f5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:13.892305 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1022/2058] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:13 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:13.893406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482075b7-eee2-40ee-ba54-a2ab67e17332 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:13.903702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482075b7-eee2-40ee-ba54-a2ab67e17332 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:13.965051 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54fb2d-8c25-472c-95b8-f4d166bda46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:13.965865 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54fb2d-8c25-472c-95b8-f4d166bda46b admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:13.966090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54fb2d-8c25-472c-95b8-f4d166bda46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:13.966367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54fb2d-8c25-472c-95b8-f4d166bda46b admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:13.967072 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54fb2d-8c25-472c-95b8-f4d166bda46b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:13.969725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54fb2d-8c25-472c-95b8-f4d166bda46b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:14.085837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1037/2059] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:13 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:14.088879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3b26-9b21-424c-b27b-5f77cf6293f5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:14.100583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3b26-9b21-424c-b27b-5f77cf6293f5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:14.106298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7495d-6fca-484c-b74b-035ede475183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:14.107815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7495d-6fca-484c-b74b-035ede475183 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:14.108121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7495d-6fca-484c-b74b-035ede475183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:14.108415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7495d-6fca-484c-b74b-035ede475183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:14.109176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7495d-6fca-484c-b74b-035ede475183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:14.110837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7495d-6fca-484c-b74b-035ede475183 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:14.129796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1023/2060] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:14.133413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54fb2d-8c25-472c-95b8-f4d166bda46b admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:14.144575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54fb2d-8c25-472c-95b8-f4d166bda46b admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:14.150027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d83f67-e689-48ef-ac21-88d8c3f8179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:14.150463 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d83f67-e689-48ef-ac21-88d8c3f8179a admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:14.150746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d83f67-e689-48ef-ac21-88d8c3f8179a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:14.151026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d83f67-e689-48ef-ac21-88d8c3f8179a admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:14.151793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d83f67-e689-48ef-ac21-88d8c3f8179a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:14.153416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d83f67-e689-48ef-ac21-88d8c3f8179a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:14.167156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1038/2061] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:14.169361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7495d-6fca-484c-b74b-035ede475183 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:14.180270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d83f67-e689-48ef-ac21-88d8c3f8179a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:14.185049 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7495d-6fca-484c-b74b-035ede475183 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:14.185270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-24d83f67-e689-48ef-ac21-88d8c3f8179a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:14.187781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d262cdc-a2b5-412b-807f-33d8483abf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:14.188940 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d262cdc-a2b5-412b-807f-33d8483abf7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:14.189374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d262cdc-a2b5-412b-807f-33d8483abf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:14.190621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d262cdc-a2b5-412b-807f-33d8483abf7d admin admin] PATH_INFO: `/v3/projects/5376211b192940d290e5de5b431d9255/users/0500a5a50de94794aea1e87bbe29223c/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:14.197908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d83f67-e689-48ef-ac21-88d8c3f8179a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:14.203700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:14.204515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:14.205573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:14.205573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] PATH_INFO: `/v3/projects/9137b47105484bd69fcd671f75694976` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:14.207424 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9137b47105484bd69fcd671f75694976)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:14.212606 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:14.214389 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d262cdc-a2b5-412b-807f-33d8483abf7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5376211b192940d290e5de5b431d9255, user_id=0500a5a50de94794aea1e87bbe29223c, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:14.217180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d262cdc-a2b5-412b-807f-33d8483abf7d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:14.682655 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1024/2062] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:14 2022] PUT /identity/v3/projects/5376211b192940d290e5de5b431d9255/users/0500a5a50de94794aea1e87bbe29223c/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:14.687811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94782d-4680-4aca-883c-dfda5cc0c189 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:14.688110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94782d-4680-4aca-883c-dfda5cc0c189 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:14.688395 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94782d-4680-4aca-883c-dfda5cc0c189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:14.709284 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9e94782d-4680-4aca-883c-dfda5cc0c189 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:14.710518 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9e94782d-4680-4aca-883c-dfda5cc0c189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:14.769994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1025/2063] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:14.783085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94782d-4680-4aca-883c-dfda5cc0c189 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:14.784497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9e94782d-4680-4aca-883c-dfda5cc0c189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:14.834489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9137b47105484bd69fcd671f75694976', 'request_id': 'req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:14.840942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9137b47105484bd69fcd671f75694976', 'request_id': 'req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:14.863998 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94782d-4680-4aca-883c-dfda5cc0c189 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:14.917999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4a509-014b-4478-bb61-6eb557222e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:14.918657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4a509-014b-4478-bb61-6eb557222e99 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:14.918932 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4a509-014b-4478-bb61-6eb557222e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:14.919237 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4a509-014b-4478-bb61-6eb557222e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:14.939928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9137b47105484bd69fcd671f75694976', 'request_id': 'req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:14.959662 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] The token cache is being invalidate because project 9137b47105484bd69fcd671f75694976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:14.960234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:14.962446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6e822e57-6a8f-46a6-b8a3-9a39a18d3e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:14.966514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1039/2064] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:14 2022] DELETE /identity/v3/projects/9137b47105484bd69fcd671f75694976 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:14.971550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b6f3f-dd15-4de0-93f6-1f43e37d2163 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:14.971842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b6f3f-dd15-4de0-93f6-1f43e37d2163 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:14.972180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b6f3f-dd15-4de0-93f6-1f43e37d2163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.003764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-eb0b6f3f-dd15-4de0-93f6-1f43e37d2163 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:15.003764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-eb0b6f3f-dd15-4de0-93f6-1f43e37d2163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:15.034286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4a509-014b-4478-bb61-6eb557222e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:15.035829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4a509-014b-4478-bb61-6eb557222e99 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:15.046107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1026/2065] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:15.066374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1040/2066] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:15.073338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf30ef3-5914-4852-941c-dbabb1230c20 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:15.073627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf30ef3-5914-4852-941c-dbabb1230c20 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:15.073908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf30ef3-5914-4852-941c-dbabb1230c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.095538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-fdf30ef3-5914-4852-941c-dbabb1230c20 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:15.096923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fdf30ef3-5914-4852-941c-dbabb1230c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:15.110115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1027/2067] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:15.112317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b6f3f-dd15-4de0-93f6-1f43e37d2163 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:15.123056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b6f3f-dd15-4de0-93f6-1f43e37d2163 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:15.129985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3e3f3-cf23-4e99-b891-232c70e4a77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:15.130767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e3f3-cf23-4e99-b891-232c70e4a77d admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:15.131221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e3f3-cf23-4e99-b891-232c70e4a77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:15.131501 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e3f3-cf23-4e99-b891-232c70e4a77d admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.132231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3e3f3-cf23-4e99-b891-232c70e4a77d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:15.132536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3e3f3-cf23-4e99-b891-232c70e4a77d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:15.134469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3e3f3-cf23-4e99-b891-232c70e4a77d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:15.147783 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1041/2068] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:28:15.152717 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf30ef3-5914-4852-941c-dbabb1230c20 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:15.166180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf30ef3-5914-4852-941c-dbabb1230c20 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:15.171388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947451-dcbe-49b6-b876-2c4c1b90d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:15.172217 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947451-dcbe-49b6-b876-2c4c1b90d06a admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:15.172497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947451-dcbe-49b6-b876-2c4c1b90d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:15.172770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947451-dcbe-49b6-b876-2c4c1b90d06a admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.173515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9947451-dcbe-49b6-b876-2c4c1b90d06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:15.175579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9947451-dcbe-49b6-b876-2c4c1b90d06a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:15.279230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3e3f3-cf23-4e99-b891-232c70e4a77d admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:15.281419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-48b3e3f3-cf23-4e99-b891-232c70e4a77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:15.292758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1028/2069] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:15 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:15.296880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947451-dcbe-49b6-b876-2c4c1b90d06a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:15.297361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3e3f3-cf23-4e99-b891-232c70e4a77d admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:15.365890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa3ea9-2098-42d1-83be-0bc4d42692b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:15.367047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3ea9-2098-42d1-83be-0bc4d42692b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:15.370845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3ea9-2098-42d1-83be-0bc4d42692b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:15.370845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3ea9-2098-42d1-83be-0bc4d42692b3 admin admin] PATH_INFO: `/v3/users/fe0586f5bde144389c0b667efbc05e9e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.371233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947451-dcbe-49b6-b876-2c4c1b90d06a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:15.371336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa3ea9-2098-42d1-83be-0bc4d42692b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe0586f5bde144389c0b667efbc05e9e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:15.371336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa3ea9-2098-42d1-83be-0bc4d42692b3 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:15.372949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd082c-a951-4544-bb1b-ed05d5b23478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:15.373620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd082c-a951-4544-bb1b-ed05d5b23478 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:15.373904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd082c-a951-4544-bb1b-ed05d5b23478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:15.374177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd082c-a951-4544-bb1b-ed05d5b23478 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.374990 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd082c-a951-4544-bb1b-ed05d5b23478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:15.377040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd082c-a951-4544-bb1b-ed05d5b23478 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:15.488941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1029/2070] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:15 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:15.492812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd082c-a951-4544-bb1b-ed05d5b23478 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:15.502292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd082c-a951-4544-bb1b-ed05d5b23478 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:15.507306 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0538d9-4b76-4487-a565-b7f266f10127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:15.507958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0538d9-4b76-4487-a565-b7f266f10127 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:15.508244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0538d9-4b76-4487-a565-b7f266f10127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:15.508525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0538d9-4b76-4487-a565-b7f266f10127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.509684 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0538d9-4b76-4487-a565-b7f266f10127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:15.510896 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0538d9-4b76-4487-a565-b7f266f10127 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:15.523797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1030/2071] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:15.531600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0538d9-4b76-4487-a565-b7f266f10127 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:15.537453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0538d9-4b76-4487-a565-b7f266f10127 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:15.541999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e5c9b-bfd2-4968-89ac-5f480b50f0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:15.542618 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e5c9b-bfd2-4968-89ac-5f480b50f0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:15.542905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e5c9b-bfd2-4968-89ac-5f480b50f0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:15.543208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e5c9b-bfd2-4968-89ac-5f480b50f0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.543915 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e5c9b-bfd2-4968-89ac-5f480b50f0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:15.545487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e5c9b-bfd2-4968-89ac-5f480b50f0ca admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:15.559384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1031/2072] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:15.563011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e5c9b-bfd2-4968-89ac-5f480b50f0ca admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:15.572559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e5c9b-bfd2-4968-89ac-5f480b50f0ca admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:15.577147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9189f6e-8cac-4ada-9d69-78356db1af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:15.578018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189f6e-8cac-4ada-9d69-78356db1af13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:15.578294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189f6e-8cac-4ada-9d69-78356db1af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:15.578568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189f6e-8cac-4ada-9d69-78356db1af13 admin admin] PATH_INFO: `/v3/projects/bca482db22de44b9b78b5545c1ed12a8/users/e4375a80b0234c3680893f3b3caefb8f/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.592725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9189f6e-8cac-4ada-9d69-78356db1af13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca482db22de44b9b78b5545c1ed12a8, user_id=e4375a80b0234c3680893f3b3caefb8f, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:15.595704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9189f6e-8cac-4ada-9d69-78356db1af13 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:15.700871 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-41aa3ea9-2098-42d1-83be-0bc4d42692b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe0586f5bde144389c0b667efbc05e9e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:15.712921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-41aa3ea9-2098-42d1-83be-0bc4d42692b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe0586f5bde144389c0b667efbc05e9e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:15.713538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-41aa3ea9-2098-42d1-83be-0bc4d42692b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe0586f5bde144389c0b667efbc05e9e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:15.732535 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1032/2073] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:15 2022] PUT /identity/v3/projects/bca482db22de44b9b78b5545c1ed12a8/users/e4375a80b0234c3680893f3b3caefb8f/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:15.741503 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66526-853c-4a60-b1dd-d0c1519fa54c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:15.741864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66526-853c-4a60-b1dd-d0c1519fa54c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:15.742221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66526-853c-4a60-b1dd-d0c1519fa54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.773359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-afb66526-853c-4a60-b1dd-d0c1519fa54c None None] MFA Rules not processed for user `e4375a80b0234c3680893f3b3caefb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:15.774659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-afb66526-853c-4a60-b1dd-d0c1519fa54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:15.836467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-41aa3ea9-2098-42d1-83be-0bc4d42692b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe0586f5bde144389c0b667efbc05e9e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:15.848177 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-41aa3ea9-2098-42d1-83be-0bc4d42692b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe0586f5bde144389c0b667efbc05e9e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:15.854437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1042/2074] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:15 2022] DELETE /identity/v3/users/fe0586f5bde144389c0b667efbc05e9e => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:15.859178 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6ba3-bdb8-4089-a140-564f159be065 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:15.859480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6ba3-bdb8-4089-a140-564f159be065 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:15.859762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e6ba3-bdb8-4089-a140-564f159be065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.867284 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1033/2075] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:15.871718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb66526-853c-4a60-b1dd-d0c1519fa54c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:15.873163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-afb66526-853c-4a60-b1dd-d0c1519fa54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:15.879822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-236e6ba3-bdb8-4089-a140-564f159be065 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:15.887166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-236e6ba3-bdb8-4089-a140-564f159be065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:15.951775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb66526-853c-4a60-b1dd-d0c1519fa54c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:15.959957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1043/2076] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:15.969289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e6ba3-bdb8-4089-a140-564f159be065 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:15.973714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120976f-7230-4b9f-8803-02c7cfa1ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:15.974434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120976f-7230-4b9f-8803-02c7cfa1ca4f admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:15.974715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120976f-7230-4b9f-8803-02c7cfa1ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:15.974990 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120976f-7230-4b9f-8803-02c7cfa1ca4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:15.975851 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120976f-7230-4b9f-8803-02c7cfa1ca4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:15.976479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-236e6ba3-bdb8-4089-a140-564f159be065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:15.978137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120976f-7230-4b9f-8803-02c7cfa1ca4f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:16.046762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e6ba3-bdb8-4089-a140-564f159be065 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:16.052035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa74993-3607-4ded-94f8-82bafbf573cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:16.052035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74993-3607-4ded-94f8-82bafbf573cb service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:16.052406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74993-3607-4ded-94f8-82bafbf573cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:16.052639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74993-3607-4ded-94f8-82bafbf573cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:16.062721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa74993-3607-4ded-94f8-82bafbf573cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:16.064334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa74993-3607-4ded-94f8-82bafbf573cb service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:16.075173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1044/2077] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:16.141691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1034/2078] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:15 2022] POST /identity/v3/projects => generated 381 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:16.146166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa74993-3607-4ded-94f8-82bafbf573cb service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:16.158872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa74993-3607-4ded-94f8-82bafbf573cb service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:16.229780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba85dda-8442-468f-90dd-23718fbf394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:16.229780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba85dda-8442-468f-90dd-23718fbf394b admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:16.229780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba85dda-8442-468f-90dd-23718fbf394b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:16.229780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba85dda-8442-468f-90dd-23718fbf394b admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:16.230280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba85dda-8442-468f-90dd-23718fbf394b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:16.230280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba85dda-8442-468f-90dd-23718fbf394b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:16.387345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1045/2079] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:16 2022] POST /identity/v3/users => generated 291 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:16.394949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120976f-7230-4b9f-8803-02c7cfa1ca4f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:16.406514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120976f-7230-4b9f-8803-02c7cfa1ca4f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:16.412047 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e9b3-b597-498a-9c97-ea6f487b74b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:16.412713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e9b3-b597-498a-9c97-ea6f487b74b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:16.412997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e9b3-b597-498a-9c97-ea6f487b74b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:16.413274 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4e9b3-b597-498a-9c97-ea6f487b74b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:16.414004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4e9b3-b597-498a-9c97-ea6f487b74b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:16.415684 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4e9b3-b597-498a-9c97-ea6f487b74b5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:16.426410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1035/2080] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:16.433423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba85dda-8442-468f-90dd-23718fbf394b admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:16.443440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba85dda-8442-468f-90dd-23718fbf394b admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:16.448081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7589449-1e7d-42f0-a631-9ca07e3a3250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:16.448740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7589449-1e7d-42f0-a631-9ca07e3a3250 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:16.449035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7589449-1e7d-42f0-a631-9ca07e3a3250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:16.449309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7589449-1e7d-42f0-a631-9ca07e3a3250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:16.450039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7589449-1e7d-42f0-a631-9ca07e3a3250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:16.451728 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7589449-1e7d-42f0-a631-9ca07e3a3250 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:16.465665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1046/2081] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:16.466976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e9b3-b597-498a-9c97-ea6f487b74b5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:16.477846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4e9b3-b597-498a-9c97-ea6f487b74b5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:16.482474 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3c4c9-0856-4a00-949f-3a53a2ac8043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:16.483318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3c4c9-0856-4a00-949f-3a53a2ac8043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:16.483603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3c4c9-0856-4a00-949f-3a53a2ac8043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:16.483876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3c4c9-0856-4a00-949f-3a53a2ac8043 admin admin] PATH_INFO: `/v3/projects/e4b556337a674678bc71fc6c6f37d665/users/eee37a53293649d29bcb1922b45cb131/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:16.498404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3c4c9-0856-4a00-949f-3a53a2ac8043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b556337a674678bc71fc6c6f37d665, user_id=eee37a53293649d29bcb1922b45cb131, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:16.501143 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3c4c9-0856-4a00-949f-3a53a2ac8043 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:16.615005 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1036/2082] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:16 2022] PUT /identity/v3/projects/e4b556337a674678bc71fc6c6f37d665/users/eee37a53293649d29bcb1922b45cb131/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:16.615830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7589449-1e7d-42f0-a631-9ca07e3a3250 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:16.618413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b7589449-1e7d-42f0-a631-9ca07e3a3250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:16.625807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc8a40-cc11-4d99-8eb3-bb13819d8fe1 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:16.626095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc8a40-cc11-4d99-8eb3-bb13819d8fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:16.626427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc8a40-cc11-4d99-8eb3-bb13819d8fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:16.638886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7589449-1e7d-42f0-a631-9ca07e3a3250 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:16.659685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-bdfc8a40-cc11-4d99-8eb3-bb13819d8fe1 None None] MFA Rules not processed for user `eee37a53293649d29bcb1922b45cb131`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:16.661292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bdfc8a40-cc11-4d99-8eb3-bb13819d8fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:16.706349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:16.707777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:16.708052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:16.708326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] PATH_INFO: `/v3/projects/b913af5b04044f4a931818385cd16d85` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:16.715325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b913af5b04044f4a931818385cd16d85)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:16.717359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:16.735170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1037/2083] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:16.737216 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04051e80-9212-497b-b48c-9b45a4f2f290 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:16.738306 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04051e80-9212-497b-b48c-9b45a4f2f290 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:16.738734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04051e80-9212-497b-b48c-9b45a4f2f290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:16.764962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-04051e80-9212-497b-b48c-9b45a4f2f290 None None] MFA Rules not processed for user `0500a5a50de94794aea1e87bbe29223c`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:16.766179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-04051e80-9212-497b-b48c-9b45a4f2f290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:16.828010 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1038/2084] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:16.828901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04051e80-9212-497b-b48c-9b45a4f2f290 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:16.839365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04051e80-9212-497b-b48c-9b45a4f2f290 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:16.848838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17270f8-fa1d-4575-bd79-f1c310735a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:16.848838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17270f8-fa1d-4575-bd79-f1c310735a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:16.848838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17270f8-fa1d-4575-bd79-f1c310735a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:16.848838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17270f8-fa1d-4575-bd79-f1c310735a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:16.849190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17270f8-fa1d-4575-bd79-f1c310735a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:16.853594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17270f8-fa1d-4575-bd79-f1c310735a11 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:16.860413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b913af5b04044f4a931818385cd16d85', 'request_id': 'req-6799a162-e082-409c-987b-20c82eab30d4'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:16.866461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b913af5b04044f4a931818385cd16d85', 'request_id': 'req-6799a162-e082-409c-987b-20c82eab30d4'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:17.029519 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1039/2085] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:16 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:17.029519 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17270f8-fa1d-4575-bd79-f1c310735a11 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.029519 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a17270f8-fa1d-4575-bd79-f1c310735a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:17.035355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b913af5b04044f4a931818385cd16d85', 'request_id': 'req-6799a162-e082-409c-987b-20c82eab30d4'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:17.043945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] The token cache is being invalidate because project b913af5b04044f4a931818385cd16d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:17.044198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:17.044855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:17.046600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1047/2086] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:16 2022] DELETE /identity/v3/projects/b913af5b04044f4a931818385cd16d85 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:17.047429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.048673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:17.104457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17270f8-fa1d-4575-bd79-f1c310735a11 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.109228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d2112-21ef-4f7a-8594-104c2c61fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.109879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d2112-21ef-4f7a-8594-104c2c61fab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.110157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d2112-21ef-4f7a-8594-104c2c61fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.110427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d2112-21ef-4f7a-8594-104c2c61fab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.111104 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d2112-21ef-4f7a-8594-104c2c61fab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:17.113115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d2112-21ef-4f7a-8594-104c2c61fab9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:17.114230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799a162-e082-409c-987b-20c82eab30d4 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.118832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5dcbe-26a2-4591-8f6a-12ba4394c446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.119527 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5dcbe-26a2-4591-8f6a-12ba4394c446 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.119821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5dcbe-26a2-4591-8f6a-12ba4394c446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.120101 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5dcbe-26a2-4591-8f6a-12ba4394c446 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.120787 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5dcbe-26a2-4591-8f6a-12ba4394c446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:17.122864 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5dcbe-26a2-4591-8f6a-12ba4394c446 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:17.204569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1040/2087] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:17 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:17.204569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d2112-21ef-4f7a-8594-104c2c61fab9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.205896 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-736d2112-21ef-4f7a-8594-104c2c61fab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:17.230733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1048/2088] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:17 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:17.231755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5dcbe-26a2-4591-8f6a-12ba4394c446 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.236730 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-13a5dcbe-26a2-4591-8f6a-12ba4394c446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:17.247793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5dcbe-26a2-4591-8f6a-12ba4394c446 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.270745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d2112-21ef-4f7a-8594-104c2c61fab9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.275567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.276456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.276735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.277013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] PATH_INFO: `/v3/users/7f43bb05a9d84cf4b75bd4be0296f043` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.278214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f43bb05a9d84cf4b75bd4be0296f043)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:17.280221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:17.306935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d216a8-efcf-42cd-9533-2ce4d70cc70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.307644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d216a8-efcf-42cd-9533-2ce4d70cc70e admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.307924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d216a8-efcf-42cd-9533-2ce4d70cc70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.308197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d216a8-efcf-42cd-9533-2ce4d70cc70e admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.308888 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d216a8-efcf-42cd-9533-2ce4d70cc70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:17.310831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d216a8-efcf-42cd-9533-2ce4d70cc70e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:17.428216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1049/2089] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:17 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:17.428216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d216a8-efcf-42cd-9533-2ce4d70cc70e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.435895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d216a8-efcf-42cd-9533-2ce4d70cc70e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.440556 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d160f-7f2a-45e4-a960-15936d66904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.441834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d160f-7f2a-45e4-a960-15936d66904b admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.442114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d160f-7f2a-45e4-a960-15936d66904b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.442390 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d160f-7f2a-45e4-a960-15936d66904b admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.443103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d160f-7f2a-45e4-a960-15936d66904b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:17.444722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d160f-7f2a-45e4-a960-15936d66904b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:17.454227 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1050/2090] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:17.461153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d160f-7f2a-45e4-a960-15936d66904b admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.464356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d160f-7f2a-45e4-a960-15936d66904b admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.469234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9044-7944-46a5-a552-f33452a58732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.469834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9044-7944-46a5-a552-f33452a58732 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.470118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9044-7944-46a5-a552-f33452a58732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.470394 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9044-7944-46a5-a552-f33452a58732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.471076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d9044-7944-46a5-a552-f33452a58732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:17.472639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d9044-7944-46a5-a552-f33452a58732 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:17.485455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1051/2091] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:17.485455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9044-7944-46a5-a552-f33452a58732 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.493048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9044-7944-46a5-a552-f33452a58732 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.497633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b172c2-26b0-44f7-b75b-4a40b6be5b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.498509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b172c2-26b0-44f7-b75b-4a40b6be5b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.498734 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b172c2-26b0-44f7-b75b-4a40b6be5b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.499006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b172c2-26b0-44f7-b75b-4a40b6be5b1a admin admin] PATH_INFO: `/v3/projects/e9bf0d96a2c54065bff7b7cc25f16ea8/users/ed920733ae8e4ac289a8bf293e59bc00/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.513907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b172c2-26b0-44f7-b75b-4a40b6be5b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9bf0d96a2c54065bff7b7cc25f16ea8, user_id=ed920733ae8e4ac289a8bf293e59bc00, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:17.516943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b172c2-26b0-44f7-b75b-4a40b6be5b1a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:17.549171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f43bb05a9d84cf4b75bd4be0296f043'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:17.561610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f43bb05a9d84cf4b75bd4be0296f043'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:17.568249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f43bb05a9d84cf4b75bd4be0296f043'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:17.568958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f43bb05a9d84cf4b75bd4be0296f043'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:17.659403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1052/2092] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:17 2022] PUT /identity/v3/projects/e9bf0d96a2c54065bff7b7cc25f16ea8/users/ed920733ae8e4ac289a8bf293e59bc00/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:17.660801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b172c2-26b0-44f7-b75b-4a40b6be5b1a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.694151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f43bb05a9d84cf4b75bd4be0296f043'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:17.702499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1041/2093] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:17 2022] DELETE /identity/v3/users/7f43bb05a9d84cf4b75bd4be0296f043 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:17.703530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.704876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:17.725872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b172c2-26b0-44f7-b75b-4a40b6be5b1a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.784178 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71ffbf-56f7-4dfc-89fc-bbe059c637a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.785536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71ffbf-56f7-4dfc-89fc-bbe059c637a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.785819 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71ffbf-56f7-4dfc-89fc-bbe059c637a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.786096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71ffbf-56f7-4dfc-89fc-bbe059c637a6 admin admin] PATH_INFO: `/v3/projects/094e03e200a0462face367f2ccbb3d9d/users/fb1372d331674e588f1d9f45b6ef5b63/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.793676 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bf2ba-51f7-4100-9ac3-a2fb3dc239b9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.798828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1583c5-06e8-4592-b173-c9afeb04884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.799542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1583c5-06e8-4592-b173-c9afeb04884a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.799890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1583c5-06e8-4592-b173-c9afeb04884a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.800178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1583c5-06e8-4592-b173-c9afeb04884a admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.801464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1583c5-06e8-4592-b173-c9afeb04884a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:17.802498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71ffbf-56f7-4dfc-89fc-bbe059c637a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094e03e200a0462face367f2ccbb3d9d, user_id=fb1372d331674e588f1d9f45b6ef5b63, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:17.803101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1583c5-06e8-4592-b173-c9afeb04884a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:17.805247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71ffbf-56f7-4dfc-89fc-bbe059c637a6 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:17.813031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1042/2094] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:17.817180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1583c5-06e8-4592-b173-c9afeb04884a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.826710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1583c5-06e8-4592-b173-c9afeb04884a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.831348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50501-32b4-48a8-be6a-5cad06abee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.832230 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50501-32b4-48a8-be6a-5cad06abee30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.832514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50501-32b4-48a8-be6a-5cad06abee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.832794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50501-32b4-48a8-be6a-5cad06abee30 admin admin] PATH_INFO: `/v3/projects/e9bf0d96a2c54065bff7b7cc25f16ea8/users/ed920733ae8e4ac289a8bf293e59bc00/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.834765 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50501-32b4-48a8-be6a-5cad06abee30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9bf0d96a2c54065bff7b7cc25f16ea8, user_id=ed920733ae8e4ac289a8bf293e59bc00, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:17.837488 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50501-32b4-48a8-be6a-5cad06abee30 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:17.848221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1043/2095] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:17 2022] PUT /identity/v3/projects/e9bf0d96a2c54065bff7b7cc25f16ea8/users/ed920733ae8e4ac289a8bf293e59bc00/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:17.858457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e922-eb4e-4f54-9cee-3eabc597e04d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.858744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e922-eb4e-4f54-9cee-3eabc597e04d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.859023 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e922-eb4e-4f54-9cee-3eabc597e04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.879752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1053/2096] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:17 2022] PUT /identity/v3/projects/094e03e200a0462face367f2ccbb3d9d/users/fb1372d331674e588f1d9f45b6ef5b63/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:17.881313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71ffbf-56f7-4dfc-89fc-bbe059c637a6 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.883743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-5d71ffbf-56f7-4dfc-89fc-bbe059c637a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:17.895876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c1c6e922-eb4e-4f54-9cee-3eabc597e04d None None] MFA Rules not processed for user `ed920733ae8e4ac289a8bf293e59bc00`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:17.897053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c1c6e922-eb4e-4f54-9cee-3eabc597e04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:17.960018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71ffbf-56f7-4dfc-89fc-bbe059c637a6 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.961038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758bc83-d6a3-4613-a577-c2345d744116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.961736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758bc83-d6a3-4613-a577-c2345d744116 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.962028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758bc83-d6a3-4613-a577-c2345d744116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.962311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758bc83-d6a3-4613-a577-c2345d744116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:17.963061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758bc83-d6a3-4613-a577-c2345d744116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:17.965171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758bc83-d6a3-4613-a577-c2345d744116 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:17.976448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1054/2097] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:17.980341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758bc83-d6a3-4613-a577-c2345d744116 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:17.986854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1044/2098] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:17.998629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758bc83-d6a3-4613-a577-c2345d744116 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:17.998629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d74d26-0a86-46b8-92d0-c373f58a0d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:17.998629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d74d26-0a86-46b8-92d0-c373f58a0d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:17.998629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d74d26-0a86-46b8-92d0-c373f58a0d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:17.999041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d74d26-0a86-46b8-92d0-c373f58a0d6a admin admin] PATH_INFO: `/v3/projects/094e03e200a0462face367f2ccbb3d9d/users/fb1372d331674e588f1d9f45b6ef5b63/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:18.003344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d74d26-0a86-46b8-92d0-c373f58a0d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=094e03e200a0462face367f2ccbb3d9d, user_id=fb1372d331674e588f1d9f45b6ef5b63, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:18.006351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d74d26-0a86-46b8-92d0-c373f58a0d6a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:18.007275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6e922-eb4e-4f54-9cee-3eabc597e04d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:18.009226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c1c6e922-eb4e-4f54-9cee-3eabc597e04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:18.017538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1055/2099] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:17 2022] PUT /identity/v3/projects/094e03e200a0462face367f2ccbb3d9d/users/fb1372d331674e588f1d9f45b6ef5b63/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:18.069863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6e922-eb4e-4f54-9cee-3eabc597e04d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:18.117858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be3ce-93ac-4ab2-945c-c3410e0db734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:18.118515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be3ce-93ac-4ab2-945c-c3410e0db734 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:18.118798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be3ce-93ac-4ab2-945c-c3410e0db734 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:18.119072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be3ce-93ac-4ab2-945c-c3410e0db734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:18.120916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-078be3ce-93ac-4ab2-945c-c3410e0db734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:18.183270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d74d26-0a86-46b8-92d0-c373f58a0d6a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:18.185143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a4d74d26-0a86-46b8-92d0-c373f58a0d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:18.195620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078be3ce-93ac-4ab2-945c-c3410e0db734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:18.197767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078be3ce-93ac-4ab2-945c-c3410e0db734 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:18.230116 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1045/2100] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:18.272855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d74d26-0a86-46b8-92d0-c373f58a0d6a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:18.278151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:18.279010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:18.279320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:18.279594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] PATH_INFO: `/v3/projects/54540f78bd5444b59da0756baf671e57` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:18.280785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54540f78bd5444b59da0756baf671e57)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:18.283417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:18.385220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54540f78bd5444b59da0756baf671e57', 'request_id': 'req-a810dd21-f41c-47e6-a608-e3585476273b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:18.393771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54540f78bd5444b59da0756baf671e57', 'request_id': 'req-a810dd21-f41c-47e6-a608-e3585476273b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:18.493796 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54540f78bd5444b59da0756baf671e57', 'request_id': 'req-a810dd21-f41c-47e6-a608-e3585476273b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:18.506483 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] The token cache is being invalidate because project 54540f78bd5444b59da0756baf671e57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:18.506772 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:18.507565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a810dd21-f41c-47e6-a608-e3585476273b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:18.514323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1056/2101] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:18 2022] DELETE /identity/v3/projects/54540f78bd5444b59da0756baf671e57 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:18.516201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dd612-b793-4e28-a1c3-175df479e1c9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:18.516604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dd612-b793-4e28-a1c3-175df479e1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:18.517731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dd612-b793-4e28-a1c3-175df479e1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:18.545931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-762dd612-b793-4e28-a1c3-175df479e1c9 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:18.547199 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-762dd612-b793-4e28-a1c3-175df479e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:18.613213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1046/2102] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:18.621706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c48d13-e302-4cfb-97be-0494c3dcdf28 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:18.621997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c48d13-e302-4cfb-97be-0494c3dcdf28 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:18.622302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c48d13-e302-4cfb-97be-0494c3dcdf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:18.640914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-21c48d13-e302-4cfb-97be-0494c3dcdf28 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:18.642167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-21c48d13-e302-4cfb-97be-0494c3dcdf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:18.650526 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1057/2103] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:18.654658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dd612-b793-4e28-a1c3-175df479e1c9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:18.665198 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dd612-b793-4e28-a1c3-175df479e1c9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:18.670262 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acd9c3-fa60-4d9a-aae5-8f2f49d53564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:18.670925 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acd9c3-fa60-4d9a-aae5-8f2f49d53564 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:18.671633 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acd9c3-fa60-4d9a-aae5-8f2f49d53564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:18.671633 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acd9c3-fa60-4d9a-aae5-8f2f49d53564 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:18.672221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acd9c3-fa60-4d9a-aae5-8f2f49d53564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:18.672525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acd9c3-fa60-4d9a-aae5-8f2f49d53564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:18.674153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acd9c3-fa60-4d9a-aae5-8f2f49d53564 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:18.685920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1047/2104] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:28:18.690221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c48d13-e302-4cfb-97be-0494c3dcdf28 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:18.699976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c48d13-e302-4cfb-97be-0494c3dcdf28 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:18.705196 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cc6ec-cdde-4435-8ba4-e76f488e38d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:18.705860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cc6ec-cdde-4435-8ba4-e76f488e38d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:18.711584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cc6ec-cdde-4435-8ba4-e76f488e38d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:18.711584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cc6ec-cdde-4435-8ba4-e76f488e38d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:18.711584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cc6ec-cdde-4435-8ba4-e76f488e38d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:18.711584 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cc6ec-cdde-4435-8ba4-e76f488e38d9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:18.817951 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1058/2105] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:18 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:18.819464 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acd9c3-fa60-4d9a-aae5-8f2f49d53564 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:18.829836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acd9c3-fa60-4d9a-aae5-8f2f49d53564 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:18.889881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6d8d4-0255-4d56-b827-c5d875a6bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:18.891094 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d8d4-0255-4d56-b827-c5d875a6bf14 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:18.891576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d8d4-0255-4d56-b827-c5d875a6bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:18.892111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d8d4-0255-4d56-b827-c5d875a6bf14 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:18.892956 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6d8d4-0255-4d56-b827-c5d875a6bf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:18.895769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6d8d4-0255-4d56-b827-c5d875a6bf14 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:19.028153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1048/2106] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:18 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:19.032460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cc6ec-cdde-4435-8ba4-e76f488e38d9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:19.047470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cc6ec-cdde-4435-8ba4-e76f488e38d9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:19.052173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0b907-7b31-4815-89e7-e465ae74347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:19.053011 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0b907-7b31-4815-89e7-e465ae74347a admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:19.053295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0b907-7b31-4815-89e7-e465ae74347a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:19.053577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0b907-7b31-4815-89e7-e465ae74347a admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:19.054364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0b907-7b31-4815-89e7-e465ae74347a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:19.056037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0b907-7b31-4815-89e7-e465ae74347a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:19.068162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1059/2107] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:19.072080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6d8d4-0255-4d56-b827-c5d875a6bf14 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:19.084222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6d8d4-0255-4d56-b827-c5d875a6bf14 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:19.089044 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f5a75-ea19-450b-a0eb-7133e962fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:19.089724 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f5a75-ea19-450b-a0eb-7133e962fa7c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:19.090005 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f5a75-ea19-450b-a0eb-7133e962fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:19.090282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f5a75-ea19-450b-a0eb-7133e962fa7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:19.091015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f5a75-ea19-450b-a0eb-7133e962fa7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:19.092676 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f5a75-ea19-450b-a0eb-7133e962fa7c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:19.103561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1049/2108] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:19.108757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0b907-7b31-4815-89e7-e465ae74347a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:19.118739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0b907-7b31-4815-89e7-e465ae74347a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:19.123708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699403e-3cd2-4f4a-be9b-d752bef8ed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:19.124597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699403e-3cd2-4f4a-be9b-d752bef8ed3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:19.124890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699403e-3cd2-4f4a-be9b-d752bef8ed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:19.125160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699403e-3cd2-4f4a-be9b-d752bef8ed3e admin admin] PATH_INFO: `/v3/projects/4b6d00497b4e4ff8a70bc2ba9308a27f/users/0d60d227e9374a108e2b6742e1aab526/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:19.146280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699403e-3cd2-4f4a-be9b-d752bef8ed3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6d00497b4e4ff8a70bc2ba9308a27f, user_id=0d60d227e9374a108e2b6742e1aab526, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:19.152553 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699403e-3cd2-4f4a-be9b-d752bef8ed3e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:19.231055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1060/2109] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:19 2022] PUT /identity/v3/projects/4b6d00497b4e4ff8a70bc2ba9308a27f/users/0d60d227e9374a108e2b6742e1aab526/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:19.242946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9693c7-3d93-415f-a191-f60975e01990 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:19.243266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9693c7-3d93-415f-a191-f60975e01990 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:19.243569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9693c7-3d93-415f-a191-f60975e01990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:19.273194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3a9693c7-3d93-415f-a191-f60975e01990 None None] MFA Rules not processed for user `0d60d227e9374a108e2b6742e1aab526`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:19.274530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3a9693c7-3d93-415f-a191-f60975e01990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:19.349383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1050/2110] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:19.351178 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699403e-3cd2-4f4a-be9b-d752bef8ed3e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:19.419312 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699403e-3cd2-4f4a-be9b-d752bef8ed3e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:19.423994 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e90daa-10ce-4a5b-9954-9d28650eed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:19.424665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e90daa-10ce-4a5b-9954-9d28650eed41 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:19.424953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e90daa-10ce-4a5b-9954-9d28650eed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:19.425264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e90daa-10ce-4a5b-9954-9d28650eed41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:19.425968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e90daa-10ce-4a5b-9954-9d28650eed41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:19.427994 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e90daa-10ce-4a5b-9954-9d28650eed41 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:19.523564 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1061/2111] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:19 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:19.529038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9693c7-3d93-415f-a191-f60975e01990 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:19.539239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9693c7-3d93-415f-a191-f60975e01990 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:19.620588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab30e-aea2-4c69-b444-86c7dea07f13 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:19.621170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab30e-aea2-4c69-b444-86c7dea07f13 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:19.621660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab30e-aea2-4c69-b444-86c7dea07f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:19.671480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b2b2-d15a-4f88-9f52-b30f981067e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:19.673190 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b2b2-d15a-4f88-9f52-b30f981067e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:19.673485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b2b2-d15a-4f88-9f52-b30f981067e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:19.673769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b2b2-d15a-4f88-9f52-b30f981067e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:19.674480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b2b2-d15a-4f88-9f52-b30f981067e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:19.676047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-1bbab30e-aea2-4c69-b444-86c7dea07f13 None None] MFA Rules not processed for user `fb1372d331674e588f1d9f45b6ef5b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:19.677103 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b2b2-d15a-4f88-9f52-b30f981067e5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:19.677326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-1bbab30e-aea2-4c69-b444-86c7dea07f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:19.769094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1062/2112] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:19.785597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbab30e-aea2-4c69-b444-86c7dea07f13 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:19.786977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-1bbab30e-aea2-4c69-b444-86c7dea07f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:19.798992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1051/2113] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:19 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:19.803903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b2b2-d15a-4f88-9f52-b30f981067e5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:19.814608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b2b2-d15a-4f88-9f52-b30f981067e5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:19.820986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087e0c7-812a-4015-9258-d0bb8b43e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:19.821796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e0c7-812a-4015-9258-d0bb8b43e420 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:19.822277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e0c7-812a-4015-9258-d0bb8b43e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:19.822560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e0c7-812a-4015-9258-d0bb8b43e420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:19.823597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087e0c7-812a-4015-9258-d0bb8b43e420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:19.826241 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087e0c7-812a-4015-9258-d0bb8b43e420 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:19.839158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1052/2114] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:19.844810 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087e0c7-812a-4015-9258-d0bb8b43e420 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:19.853324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbab30e-aea2-4c69-b444-86c7dea07f13 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:19.854308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087e0c7-812a-4015-9258-d0bb8b43e420 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:19.857265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9a1bd-0251-41d4-a989-62b63b186600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:19.857919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a1bd-0251-41d4-a989-62b63b186600 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:19.858207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a1bd-0251-41d4-a989-62b63b186600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:19.858638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a1bd-0251-41d4-a989-62b63b186600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:19.859589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dc8ed-65b4-4482-9ff1-df0ab5be553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:19.860334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc8ed-65b4-4482-9ff1-df0ab5be553f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:19.860563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-eea9a1bd-0251-41d4-a989-62b63b186600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:19.860675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc8ed-65b4-4482-9ff1-df0ab5be553f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:19.860894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc8ed-65b4-4482-9ff1-df0ab5be553f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:19.861616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dc8ed-65b4-4482-9ff1-df0ab5be553f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:19.864213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dc8ed-65b4-4482-9ff1-df0ab5be553f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:19.875109 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1053/2115] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:19.882775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dc8ed-65b4-4482-9ff1-df0ab5be553f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:19.895815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dc8ed-65b4-4482-9ff1-df0ab5be553f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:19.902054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713207c-a533-4358-a402-0e81602e3d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:19.903272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713207c-a533-4358-a402-0e81602e3d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:19.903690 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713207c-a533-4358-a402-0e81602e3d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:19.904117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713207c-a533-4358-a402-0e81602e3d19 admin admin] PATH_INFO: `/v3/projects/ebe8746a5a484bec96199853f6b444d2/users/99c97cce12be4c97a48257c1c42f1899/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:19.928946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713207c-a533-4358-a402-0e81602e3d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe8746a5a484bec96199853f6b444d2, user_id=99c97cce12be4c97a48257c1c42f1899, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:19.930630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9a1bd-0251-41d4-a989-62b63b186600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:19.932058 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713207c-a533-4358-a402-0e81602e3d19 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:19.932176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9a1bd-0251-41d4-a989-62b63b186600 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:19.941653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1063/2116] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:20.065156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1054/2117] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:19 2022] PUT /identity/v3/projects/ebe8746a5a484bec96199853f6b444d2/users/99c97cce12be4c97a48257c1c42f1899/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:20.075421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762524f-c9f4-4a57-8d34-cabd580c9413 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:20.075719 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762524f-c9f4-4a57-8d34-cabd580c9413 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:20.076003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762524f-c9f4-4a57-8d34-cabd580c9413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:20.102873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-8762524f-c9f4-4a57-8d34-cabd580c9413 None None] MFA Rules not processed for user `99c97cce12be4c97a48257c1c42f1899`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:20.104223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8762524f-c9f4-4a57-8d34-cabd580c9413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:20.175791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1064/2118] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:20.180161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713207c-a533-4358-a402-0e81602e3d19 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:20.251067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713207c-a533-4358-a402-0e81602e3d19 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:20.255938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ba18c-9967-4aec-a975-f63746aad540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:20.258835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba18c-9967-4aec-a975-f63746aad540 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:20.258835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba18c-9967-4aec-a975-f63746aad540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:20.258835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba18c-9967-4aec-a975-f63746aad540 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:20.258835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ba18c-9967-4aec-a975-f63746aad540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:20.259789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ba18c-9967-4aec-a975-f63746aad540 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:20.380132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1055/2119] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:20 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:20.384014 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762524f-c9f4-4a57-8d34-cabd580c9413 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:20.395411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762524f-c9f4-4a57-8d34-cabd580c9413 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:20.449638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276887d-283d-42e2-99bd-4bbfffb3cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:20.450231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276887d-283d-42e2-99bd-4bbfffb3cd41 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:20.450509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276887d-283d-42e2-99bd-4bbfffb3cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:20.450779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276887d-283d-42e2-99bd-4bbfffb3cd41 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:20.451492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276887d-283d-42e2-99bd-4bbfffb3cd41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:20.453470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276887d-283d-42e2-99bd-4bbfffb3cd41 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:20.589992 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1065/2120] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:20 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:20.590544 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ba18c-9967-4aec-a975-f63746aad540 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:20.601405 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ba18c-9967-4aec-a975-f63746aad540 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:20.606649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362833f-c4f0-4559-bc6f-b8516ef25fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:20.607299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362833f-c4f0-4559-bc6f-b8516ef25fce admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:20.607585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362833f-c4f0-4559-bc6f-b8516ef25fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:20.607863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362833f-c4f0-4559-bc6f-b8516ef25fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:20.608670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362833f-c4f0-4559-bc6f-b8516ef25fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:20.610239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362833f-c4f0-4559-bc6f-b8516ef25fce admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:20.625300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1056/2121] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:20.635393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276887d-283d-42e2-99bd-4bbfffb3cd41 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:20.650807 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276887d-283d-42e2-99bd-4bbfffb3cd41 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:20.655737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252e17d-2760-4d0d-9015-2b31d0e1bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:20.656627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252e17d-2760-4d0d-9015-2b31d0e1bdcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:20.657005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252e17d-2760-4d0d-9015-2b31d0e1bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:20.657176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252e17d-2760-4d0d-9015-2b31d0e1bdcb admin admin] PATH_INFO: `/v3/projects/6b9574f7d2314b0e99aa578f9bd0d767/users/b1fdfc4647b64cbc82c6fd9ee737317e/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:20.673218 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252e17d-2760-4d0d-9015-2b31d0e1bdcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9574f7d2314b0e99aa578f9bd0d767, user_id=b1fdfc4647b64cbc82c6fd9ee737317e, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:20.675961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252e17d-2760-4d0d-9015-2b31d0e1bdcb admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:20.768216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1066/2122] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:20 2022] PUT /identity/v3/projects/6b9574f7d2314b0e99aa578f9bd0d767/users/b1fdfc4647b64cbc82c6fd9ee737317e/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:20.778764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362833f-c4f0-4559-bc6f-b8516ef25fce admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:20.788721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362833f-c4f0-4559-bc6f-b8516ef25fce admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:20.852499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d66a75-4e80-4b7b-84d5-59925c161c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:20.853229 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d66a75-4e80-4b7b-84d5-59925c161c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:20.853466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d66a75-4e80-4b7b-84d5-59925c161c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:20.853721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d66a75-4e80-4b7b-84d5-59925c161c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:20.854445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d66a75-4e80-4b7b-84d5-59925c161c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:20.856115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d66a75-4e80-4b7b-84d5-59925c161c77 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:20.866427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1057/2123] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:20.870637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252e17d-2760-4d0d-9015-2b31d0e1bdcb admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:20.881258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252e17d-2760-4d0d-9015-2b31d0e1bdcb admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:20.886421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a867ef8-73e0-4efd-95f1-94ad5b74bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:20.887342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a867ef8-73e0-4efd-95f1-94ad5b74bc42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:20.887623 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a867ef8-73e0-4efd-95f1-94ad5b74bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:20.887919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a867ef8-73e0-4efd-95f1-94ad5b74bc42 admin admin] PATH_INFO: `/v3/projects/6b9574f7d2314b0e99aa578f9bd0d767/users/b1fdfc4647b64cbc82c6fd9ee737317e/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:20.890515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a867ef8-73e0-4efd-95f1-94ad5b74bc42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9574f7d2314b0e99aa578f9bd0d767, user_id=b1fdfc4647b64cbc82c6fd9ee737317e, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:20.893485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a867ef8-73e0-4efd-95f1-94ad5b74bc42 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:20.909912 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1067/2124] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:20 2022] PUT /identity/v3/projects/6b9574f7d2314b0e99aa578f9bd0d767/users/b1fdfc4647b64cbc82c6fd9ee737317e/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:20.922332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1872-8e4a-48ee-ac34-ba0e7d6c399f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:20.922694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1872-8e4a-48ee-ac34-ba0e7d6c399f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:20.922968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1872-8e4a-48ee-ac34-ba0e7d6c399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:20.950322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-dd5c1872-8e4a-48ee-ac34-ba0e7d6c399f None None] MFA Rules not processed for user `b1fdfc4647b64cbc82c6fd9ee737317e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:20.951582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dd5c1872-8e4a-48ee-ac34-ba0e7d6c399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:21.032672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1058/2125] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:21.061847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a867ef8-73e0-4efd-95f1-94ad5b74bc42 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:21.063641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-4a867ef8-73e0-4efd-95f1-94ad5b74bc42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:21.125497 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a867ef8-73e0-4efd-95f1-94ad5b74bc42 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:21.129512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2372-0717-4bbe-af09-476bcb6abe62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:21.130279 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2372-0717-4bbe-af09-476bcb6abe62 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:21.130933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2372-0717-4bbe-af09-476bcb6abe62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:21.131252 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2372-0717-4bbe-af09-476bcb6abe62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:21.141422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c2372-0717-4bbe-af09-476bcb6abe62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:21.143076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c2372-0717-4bbe-af09-476bcb6abe62 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:21.153644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1068/2126] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:21.252465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c1872-8e4a-48ee-ac34-ba0e7d6c399f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:21.262895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c1872-8e4a-48ee-ac34-ba0e7d6c399f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:21.266448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e651d-1c0b-4875-abc5-24aacfad0d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:21.267084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e651d-1c0b-4875-abc5-24aacfad0d86 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:21.267418 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e651d-1c0b-4875-abc5-24aacfad0d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:21.267690 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e651d-1c0b-4875-abc5-24aacfad0d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:21.326412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e651d-1c0b-4875-abc5-24aacfad0d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:21.329774 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e651d-1c0b-4875-abc5-24aacfad0d86 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:21.337850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1059/2127] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:21.422064 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2372-0717-4bbe-af09-476bcb6abe62 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:21.430713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2372-0717-4bbe-af09-476bcb6abe62 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:21.434605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e6f7d-e2f1-4fa5-9b06-bc7ede7999db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:21.435460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e6f7d-e2f1-4fa5-9b06-bc7ede7999db service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:21.435744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e6f7d-e2f1-4fa5-9b06-bc7ede7999db service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:21.436020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e6f7d-e2f1-4fa5-9b06-bc7ede7999db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:21.437818 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-477e6f7d-e2f1-4fa5-9b06-bc7ede7999db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:21.502783 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e6f7d-e2f1-4fa5-9b06-bc7ede7999db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:21.504754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e6f7d-e2f1-4fa5-9b06-bc7ede7999db service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:21.513382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1069/2128] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:22.123908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e651d-1c0b-4875-abc5-24aacfad0d86 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:22.133216 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e651d-1c0b-4875-abc5-24aacfad0d86 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:22.137064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c0a4-4791-4bbe-a36d-fd45442497f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:22.137817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c0a4-4791-4bbe-a36d-fd45442497f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:22.138016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c0a4-4791-4bbe-a36d-fd45442497f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:22.138285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c0a4-4791-4bbe-a36d-fd45442497f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:22.201445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335c0a4-4791-4bbe-a36d-fd45442497f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:22.203027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335c0a4-4791-4bbe-a36d-fd45442497f9 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:22.212706 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1060/2129] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:23.360800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e6f7d-e2f1-4fa5-9b06-bc7ede7999db service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:23.369112 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e6f7d-e2f1-4fa5-9b06-bc7ede7999db service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:23.372885 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676cfbd-8add-48e9-991c-150da0ce58f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:23.373514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676cfbd-8add-48e9-991c-150da0ce58f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:23.373821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676cfbd-8add-48e9-991c-150da0ce58f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:23.374093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676cfbd-8add-48e9-991c-150da0ce58f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:23.375862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8676cfbd-8add-48e9-991c-150da0ce58f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:23.443696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676cfbd-8add-48e9-991c-150da0ce58f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:23.445222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676cfbd-8add-48e9-991c-150da0ce58f3 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:23.455031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1070/2130] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:26.151323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c0a4-4791-4bbe-a36d-fd45442497f9 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:26.152863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c335c0a4-4791-4bbe-a36d-fd45442497f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:26.216918 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c0a4-4791-4bbe-a36d-fd45442497f9 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:26.221682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:26.223230 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:26.223520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:26.223793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] PATH_INFO: `/v3/users/af2ddeccca5547bfa8ad3804e9041b65` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:26.224967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2ddeccca5547bfa8ad3804e9041b65)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:26.226899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:26.387192 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2ddeccca5547bfa8ad3804e9041b65'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:26.399282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2ddeccca5547bfa8ad3804e9041b65'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:26.407221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2ddeccca5547bfa8ad3804e9041b65'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:26.408016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2ddeccca5547bfa8ad3804e9041b65'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:26.470419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2ddeccca5547bfa8ad3804e9041b65'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:26.477769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1061/2131] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:26 2022] DELETE /identity/v3/users/af2ddeccca5547bfa8ad3804e9041b65 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:26.567413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63201-ea69-4cce-9932-9fcc43e6a41c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:26.567924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63201-ea69-4cce-9932-9fcc43e6a41c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:26.568016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a63201-ea69-4cce-9932-9fcc43e6a41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:26.587948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-63a63201-ea69-4cce-9932-9fcc43e6a41c None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:26.589171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-63a63201-ea69-4cce-9932-9fcc43e6a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:26.618349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:26.620918 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:26.655185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1071/2132] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:28:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:26.691050 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b3f62-4dab-4734-b7b8-ca4922f8b602 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:26.697998 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1de20-cf72-4f52-8fca-a3cfc3ce4a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:26.699375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a63201-ea69-4cce-9932-9fcc43e6a41c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:26.699865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1de20-cf72-4f52-8fca-a3cfc3ce4a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:26.700156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1de20-cf72-4f52-8fca-a3cfc3ce4a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:26.700442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1de20-cf72-4f52-8fca-a3cfc3ce4a30 admin admin] PATH_INFO: `/v3/users/0d60d227e9374a108e2b6742e1aab526` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:26.700966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-63a63201-ea69-4cce-9932-9fcc43e6a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:26.701715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1de20-cf72-4f52-8fca-a3cfc3ce4a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d60d227e9374a108e2b6742e1aab526)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:26.703753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1de20-cf72-4f52-8fca-a3cfc3ce4a30 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:26.777120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a63201-ea69-4cce-9932-9fcc43e6a41c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:26.782084 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dffba-b890-45a8-8772-fe7e48e9ff86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:26.782732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dffba-b890-45a8-8772-fe7e48e9ff86 service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:26.783020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dffba-b890-45a8-8772-fe7e48e9ff86 service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:26.783327 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dffba-b890-45a8-8772-fe7e48e9ff86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:26.791291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21dffba-b890-45a8-8772-fe7e48e9ff86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:26.792900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21dffba-b890-45a8-8772-fe7e48e9ff86 service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:26.800908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1072/2133] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:28:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 17:28:26.801688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dffba-b890-45a8-8772-fe7e48e9ff86 service swift] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:26.802953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a21dffba-b890-45a8-8772-fe7e48e9ff86 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:26.816854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dffba-b890-45a8-8772-fe7e48e9ff86 service swift] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:26.821913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:26.823002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:26.823786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:26.823786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] PATH_INFO: `/v3/projects/7123f57c394d4a35b46f5bf62d48abb7` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:26.827888 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7123f57c394d4a35b46f5bf62d48abb7)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:26.827888 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:26.860660 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-96b1de20-cf72-4f52-8fca-a3cfc3ce4a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d60d227e9374a108e2b6742e1aab526'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:26.873157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-96b1de20-cf72-4f52-8fca-a3cfc3ce4a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d60d227e9374a108e2b6742e1aab526'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:26.880460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-96b1de20-cf72-4f52-8fca-a3cfc3ce4a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d60d227e9374a108e2b6742e1aab526'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:26.881123 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-96b1de20-cf72-4f52-8fca-a3cfc3ce4a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d60d227e9374a108e2b6742e1aab526'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:26.953148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7123f57c394d4a35b46f5bf62d48abb7', 'request_id': 'req-46a0ebd3-b067-4649-8a2d-67288aa27ddf'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:26.968715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7123f57c394d4a35b46f5bf62d48abb7', 'request_id': 'req-46a0ebd3-b067-4649-8a2d-67288aa27ddf'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:27.007641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-96b1de20-cf72-4f52-8fca-a3cfc3ce4a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d60d227e9374a108e2b6742e1aab526'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:27.014335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1062/2134] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:26 2022] DELETE /identity/v3/users/0d60d227e9374a108e2b6742e1aab526 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:27.018970 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637efba6-3a47-4414-8128-ea8316480597 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.019296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637efba6-3a47-4414-8128-ea8316480597 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.019577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637efba6-3a47-4414-8128-ea8316480597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.036499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-637efba6-3a47-4414-8128-ea8316480597 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:27.037710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-637efba6-3a47-4414-8128-ea8316480597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:27.094740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1063/2135] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:27.104372 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637efba6-3a47-4414-8128-ea8316480597 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:27.104873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7123f57c394d4a35b46f5bf62d48abb7', 'request_id': 'req-46a0ebd3-b067-4649-8a2d-67288aa27ddf'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:27.105767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-637efba6-3a47-4414-8128-ea8316480597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:27.117173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] The token cache is being invalidate because project 7123f57c394d4a35b46f5bf62d48abb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:27.117455 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:27.118096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-46a0ebd3-b067-4649-8a2d-67288aa27ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:27.119881 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1073/2136] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:26 2022] DELETE /identity/v3/projects/7123f57c394d4a35b46f5bf62d48abb7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:27.124715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291938fd-6745-4925-b4a7-024829648f2e None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.125043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291938fd-6745-4925-b4a7-024829648f2e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.125397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291938fd-6745-4925-b4a7-024829648f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.145213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-291938fd-6745-4925-b4a7-024829648f2e None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:27.146706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-291938fd-6745-4925-b4a7-024829648f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:27.156998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1074/2137] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:27.163790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637efba6-3a47-4414-8128-ea8316480597 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:27.165847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4789dd9-4bc3-4d4f-9174-37188e358b8e None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.166138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4789dd9-4bc3-4d4f-9174-37188e358b8e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.166418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4789dd9-4bc3-4d4f-9174-37188e358b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.172746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e75b2-dcd0-4065-b29b-66503d154d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:27.172746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e75b2-dcd0-4065-b29b-66503d154d81 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.172746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e75b2-dcd0-4065-b29b-66503d154d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.172746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e75b2-dcd0-4065-b29b-66503d154d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.173029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f55e75b2-dcd0-4065-b29b-66503d154d81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:27.189192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-b4789dd9-4bc3-4d4f-9174-37188e358b8e None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:27.189192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b4789dd9-4bc3-4d4f-9174-37188e358b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:27.192497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e75b2-dcd0-4065-b29b-66503d154d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:27.195319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e75b2-dcd0-4065-b29b-66503d154d81 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:27.197421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1075/2138] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:27.201493 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4789dd9-4bc3-4d4f-9174-37188e358b8e None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:27.207794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1064/2139] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:27.211715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4789dd9-4bc3-4d4f-9174-37188e358b8e None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:27.217467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e305-dc81-4f92-9132-8117745d4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:27.218130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e305-dc81-4f92-9132-8117745d4c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.218409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e305-dc81-4f92-9132-8117745d4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.218679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e305-dc81-4f92-9132-8117745d4c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.219720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99e305-dc81-4f92-9132-8117745d4c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:27.220023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99e305-dc81-4f92-9132-8117745d4c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:27.221630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99e305-dc81-4f92-9132-8117745d4c35 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:27.233723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1076/2140] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:28:27.238805 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e75b2-dcd0-4065-b29b-66503d154d81 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:27.248545 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e75b2-dcd0-4065-b29b-66503d154d81 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:27.256130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9165ef4-4d3a-4d84-b804-5b5bf32f205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:27.257034 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165ef4-4d3a-4d84-b804-5b5bf32f205b admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.257525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165ef4-4d3a-4d84-b804-5b5bf32f205b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.257730 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165ef4-4d3a-4d84-b804-5b5bf32f205b admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.258558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9165ef4-4d3a-4d84-b804-5b5bf32f205b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:27.260630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9165ef4-4d3a-4d84-b804-5b5bf32f205b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:27.346623 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1065/2141] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:27 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:27.355406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e305-dc81-4f92-9132-8117745d4c35 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:27.369162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e305-dc81-4f92-9132-8117745d4c35 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:27.446785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471cae9-53b0-4c15-912a-ab08d6e5605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:27.447593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471cae9-53b0-4c15-912a-ab08d6e5605f admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.458701 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471cae9-53b0-4c15-912a-ab08d6e5605f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.458701 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471cae9-53b0-4c15-912a-ab08d6e5605f admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.458701 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471cae9-53b0-4c15-912a-ab08d6e5605f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:27.458701 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471cae9-53b0-4c15-912a-ab08d6e5605f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:27.562520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1077/2142] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:27 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:27.567574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9165ef4-4d3a-4d84-b804-5b5bf32f205b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:27.577622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9165ef4-4d3a-4d84-b804-5b5bf32f205b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:27.582578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55231fd-10ab-481f-86f7-c17b917a9b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:27.583361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55231fd-10ab-481f-86f7-c17b917a9b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.583934 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55231fd-10ab-481f-86f7-c17b917a9b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.584370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55231fd-10ab-481f-86f7-c17b917a9b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.585260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55231fd-10ab-481f-86f7-c17b917a9b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:27.586893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55231fd-10ab-481f-86f7-c17b917a9b8e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:27.599610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1066/2143] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:27.603696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471cae9-53b0-4c15-912a-ab08d6e5605f admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:27.614335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471cae9-53b0-4c15-912a-ab08d6e5605f admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:27.625387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14926453-521b-4005-b866-fa7077fe2dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:27.625387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14926453-521b-4005-b866-fa7077fe2dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.625387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14926453-521b-4005-b866-fa7077fe2dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.625387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14926453-521b-4005-b866-fa7077fe2dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.625733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14926453-521b-4005-b866-fa7077fe2dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:27.625733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14926453-521b-4005-b866-fa7077fe2dd9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:27.635548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1078/2144] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:27.636707 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55231fd-10ab-481f-86f7-c17b917a9b8e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:27.648573 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55231fd-10ab-481f-86f7-c17b917a9b8e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:27.649681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14926453-521b-4005-b866-fa7077fe2dd9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:27.651756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-14926453-521b-4005-b866-fa7077fe2dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:27.655412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc06e7-e15c-40a7-bed6-925247d416e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:27.656181 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc06e7-e15c-40a7-bed6-925247d416e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.656781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc06e7-e15c-40a7-bed6-925247d416e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.657807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc06e7-e15c-40a7-bed6-925247d416e2 admin admin] PATH_INFO: `/v3/projects/27832590c00f47b7b09c343e892f310a/users/a0294c57ba3f41bc8cf2cac294bb678c/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.677587 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc06e7-e15c-40a7-bed6-925247d416e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27832590c00f47b7b09c343e892f310a, user_id=a0294c57ba3f41bc8cf2cac294bb678c, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:27.680180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14926453-521b-4005-b866-fa7077fe2dd9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:27.680400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc06e7-e15c-40a7-bed6-925247d416e2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:27.687672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:27.687672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.687672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.687672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] PATH_INFO: `/v3/projects/4b6d00497b4e4ff8a70bc2ba9308a27f` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.688748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6d00497b4e4ff8a70bc2ba9308a27f)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:27.690700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:27.756972 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1067/2145] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:27 2022] PUT /identity/v3/projects/27832590c00f47b7b09c343e892f310a/users/a0294c57ba3f41bc8cf2cac294bb678c/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:27.762445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd5bf-eb67-45d4-bd18-4616e561210f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.762843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd5bf-eb67-45d4-bd18-4616e561210f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.763382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd5bf-eb67-45d4-bd18-4616e561210f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.783158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b52bd5bf-eb67-45d4-bd18-4616e561210f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:27.784382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b52bd5bf-eb67-45d4-bd18-4616e561210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:27.813658 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6d00497b4e4ff8a70bc2ba9308a27f', 'request_id': 'req-d6c90d86-7a31-4ff7-9971-0b580d60d116'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:27.820523 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6d00497b4e4ff8a70bc2ba9308a27f', 'request_id': 'req-d6c90d86-7a31-4ff7-9971-0b580d60d116'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:27.842475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1068/2146] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:27.844066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261d70-1e2d-48c7-bee4-eb356754839b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.844360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261d70-1e2d-48c7-bee4-eb356754839b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.844638 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261d70-1e2d-48c7-bee4-eb356754839b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:27.863977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-bd261d70-1e2d-48c7-bee4-eb356754839b None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:27.865186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bd261d70-1e2d-48c7-bee4-eb356754839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:27.888239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6d00497b4e4ff8a70bc2ba9308a27f', 'request_id': 'req-d6c90d86-7a31-4ff7-9971-0b580d60d116'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:27.901503 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] The token cache is being invalidate because project 4b6d00497b4e4ff8a70bc2ba9308a27f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:27.902001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:27.902681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:27.904758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1079/2147] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:27 2022] DELETE /identity/v3/projects/4b6d00497b4e4ff8a70bc2ba9308a27f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:27.906966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:27.907238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:27.927571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1069/2148] 10.222.0.64 () {58 vars in 967 bytes} [Fri May 13 17:28:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:27.928280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd261d70-1e2d-48c7-bee4-eb356754839b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:27.929568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bd261d70-1e2d-48c7-bee4-eb356754839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:27.976148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c90d86-7a31-4ff7-9971-0b580d60d116 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:27.987894 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3de7c-14b8-4411-bd49-4b73a20e9f1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:27.990168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3de7c-14b8-4411-bd49-4b73a20e9f1a service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:27.990168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3de7c-14b8-4411-bd49-4b73a20e9f1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:27.990168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3de7c-14b8-4411-bd49-4b73a20e9f1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:28.000255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e4a3de7c-14b8-4411-bd49-4b73a20e9f1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:28.024978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd261d70-1e2d-48c7-bee4-eb356754839b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:28.030460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:28.031385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:28.031670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:28.031949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] PATH_INFO: `/v3/users/99c97cce12be4c97a48257c1c42f1899` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:28.033157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c97cce12be4c97a48257c1c42f1899)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:28.035873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:28.069223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3de7c-14b8-4411-bd49-4b73a20e9f1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:28.070775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3de7c-14b8-4411-bd49-4b73a20e9f1a service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:28.080269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1080/2149] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:28.081075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3de7c-14b8-4411-bd49-4b73a20e9f1a service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:28.082385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e4a3de7c-14b8-4411-bd49-4b73a20e9f1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:28.152800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3de7c-14b8-4411-bd49-4b73a20e9f1a service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:28.158170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad308749-fb68-4067-a33b-ee02f27cb003 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:28.158853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308749-fb68-4067-a33b-ee02f27cb003 service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:28.159154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308749-fb68-4067-a33b-ee02f27cb003 service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:28.159487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308749-fb68-4067-a33b-ee02f27cb003 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:28.168160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad308749-fb68-4067-a33b-ee02f27cb003 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:28.169762 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad308749-fb68-4067-a33b-ee02f27cb003 service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:28.178427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1081/2150] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:28:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:28:28.213645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c97cce12be4c97a48257c1c42f1899'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:28.229757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c97cce12be4c97a48257c1c42f1899'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:28.236529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c97cce12be4c97a48257c1c42f1899'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:28.237272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c97cce12be4c97a48257c1c42f1899'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:28.344815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c97cce12be4c97a48257c1c42f1899'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:28.351836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1070/2151] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:27 2022] DELETE /identity/v3/users/99c97cce12be4c97a48257c1c42f1899 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:28.836970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd32a-cea5-4b68-b01a-0f19c39f5a5b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:28.837474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd32a-cea5-4b68-b01a-0f19c39f5a5b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:28.837550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effd32a-cea5-4b68-b01a-0f19c39f5a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:28.855632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-1effd32a-cea5-4b68-b01a-0f19c39f5a5b None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:28.856849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-1effd32a-cea5-4b68-b01a-0f19c39f5a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:28.906996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:28.908507 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:28.929577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1082/2152] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:28:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:28.948154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effd32a-cea5-4b68-b01a-0f19c39f5a5b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:28.949975 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-1effd32a-cea5-4b68-b01a-0f19c39f5a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:28.999479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e16c3e-5855-4a64-9c33-b12e40bef491 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:29.004228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:29.005469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:29.005853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:29.006133 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] PATH_INFO: `/v3/projects/ebe8746a5a484bec96199853f6b444d2` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:29.007466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe8746a5a484bec96199853f6b444d2)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:29.009412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:29.031377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effd32a-cea5-4b68-b01a-0f19c39f5a5b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:29.038073 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f119fa-768b-4b98-9af9-c18fe1bf7907 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:29.038740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f119fa-768b-4b98-9af9-c18fe1bf7907 service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:29.039029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f119fa-768b-4b98-9af9-c18fe1bf7907 service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:29.039355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f119fa-768b-4b98-9af9-c18fe1bf7907 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:29.048027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f119fa-768b-4b98-9af9-c18fe1bf7907 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:29.049637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f119fa-768b-4b98-9af9-c18fe1bf7907 service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:29.058488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1083/2153] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:28:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:28:29.144757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe8746a5a484bec96199853f6b444d2', 'request_id': 'req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.150374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe8746a5a484bec96199853f6b444d2', 'request_id': 'req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.213082 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe8746a5a484bec96199853f6b444d2', 'request_id': 'req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.225897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] The token cache is being invalidate because project ebe8746a5a484bec96199853f6b444d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:29.226417 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.226832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.228605 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1071/2154] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:28 2022] DELETE /identity/v3/projects/ebe8746a5a484bec96199853f6b444d2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:29.232820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f119fa-768b-4b98-9af9-c18fe1bf7907 service swift] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:29.243393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f119fa-768b-4b98-9af9-c18fe1bf7907 service swift] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:29.300597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:29.301826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da03b5-b574-456f-9346-cc8ea9b957c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:29.301968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:29.302777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da03b5-b574-456f-9346-cc8ea9b957c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:29.303074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da03b5-b574-456f-9346-cc8ea9b957c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:29.303388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da03b5-b574-456f-9346-cc8ea9b957c1 admin admin] PATH_INFO: `/v3/users/b1fdfc4647b64cbc82c6fd9ee737317e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:29.304685 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da03b5-b574-456f-9346-cc8ea9b957c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fdfc4647b64cbc82c6fd9ee737317e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:29.306647 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da03b5-b574-456f-9346-cc8ea9b957c1 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:29.314638 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295d7a7-37d5-4d95-a1fa-68c8dfdd3650 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:29.320737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867612a-6c49-4b4a-8577-cc672c0261ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:29.320737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867612a-6c49-4b4a-8577-cc672c0261ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:29.320737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867612a-6c49-4b4a-8577-cc672c0261ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:29.321129 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867612a-6c49-4b4a-8577-cc672c0261ad admin admin] PATH_INFO: `/v3/users/e4375a80b0234c3680893f3b3caefb8f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:29.322125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867612a-6c49-4b4a-8577-cc672c0261ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4375a80b0234c3680893f3b3caefb8f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:29.324117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867612a-6c49-4b4a-8577-cc672c0261ad admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:29.488940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f9da03b5-b574-456f-9346-cc8ea9b957c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fdfc4647b64cbc82c6fd9ee737317e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.501454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f9da03b5-b574-456f-9346-cc8ea9b957c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fdfc4647b64cbc82c6fd9ee737317e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.502643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f9da03b5-b574-456f-9346-cc8ea9b957c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fdfc4647b64cbc82c6fd9ee737317e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.503288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7867612a-6c49-4b4a-8577-cc672c0261ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4375a80b0234c3680893f3b3caefb8f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.519180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7867612a-6c49-4b4a-8577-cc672c0261ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4375a80b0234c3680893f3b3caefb8f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.534493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7867612a-6c49-4b4a-8577-cc672c0261ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4375a80b0234c3680893f3b3caefb8f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.536770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7867612a-6c49-4b4a-8577-cc672c0261ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4375a80b0234c3680893f3b3caefb8f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.551925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f9da03b5-b574-456f-9346-cc8ea9b957c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fdfc4647b64cbc82c6fd9ee737317e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.562690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f9da03b5-b574-456f-9346-cc8ea9b957c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fdfc4647b64cbc82c6fd9ee737317e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.575145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1084/2155] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:29 2022] DELETE /identity/v3/users/b1fdfc4647b64cbc82c6fd9ee737317e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:29.602011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7867612a-6c49-4b4a-8577-cc672c0261ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4375a80b0234c3680893f3b3caefb8f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:29.610620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1072/2156] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:29 2022] DELETE /identity/v3/users/e4375a80b0234c3680893f3b3caefb8f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:29.616339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d92e0-cdae-45f6-8eaf-15150d52b01f None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:29.616637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d92e0-cdae-45f6-8eaf-15150d52b01f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:29.616924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d92e0-cdae-45f6-8eaf-15150d52b01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:29.648986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-0c9d92e0-cdae-45f6-8eaf-15150d52b01f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:29.650945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0c9d92e0-cdae-45f6-8eaf-15150d52b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:29.721283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1085/2157] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:29.748959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07621ff-7159-4071-882f-9ca89813bd5e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:29.749481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07621ff-7159-4071-882f-9ca89813bd5e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:29.749766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07621ff-7159-4071-882f-9ca89813bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:29.762592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d92e0-cdae-45f6-8eaf-15150d52b01f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:29.764933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0c9d92e0-cdae-45f6-8eaf-15150d52b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:29.769959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f07621ff-7159-4071-882f-9ca89813bd5e None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:29.771286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f07621ff-7159-4071-882f-9ca89813bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:29.837317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d92e0-cdae-45f6-8eaf-15150d52b01f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:29.839962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1073/2158] 10.222.0.64 () {58 vars in 967 bytes} [Fri May 13 17:28:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:29.842003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5fe7c-1995-43c1-a1cf-069738e62231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:29.842669 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5fe7c-1995-43c1-a1cf-069738e62231 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:29.842952 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5fe7c-1995-43c1-a1cf-069738e62231 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:29.843261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5fe7c-1995-43c1-a1cf-069738e62231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:29.855547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5fe7c-1995-43c1-a1cf-069738e62231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:29.857456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5fe7c-1995-43c1-a1cf-069738e62231 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:29.860428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07621ff-7159-4071-882f-9ca89813bd5e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:29.866769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f07621ff-7159-4071-882f-9ca89813bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:29.871084 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1086/2159] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:29.950790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07621ff-7159-4071-882f-9ca89813bd5e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:29.965374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41399b6e-b6e9-4578-b400-c36792cdc412 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:29.967887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399b6e-b6e9-4578-b400-c36792cdc412 service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:29.967887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399b6e-b6e9-4578-b400-c36792cdc412 service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:29.967887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399b6e-b6e9-4578-b400-c36792cdc412 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:29.977719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41399b6e-b6e9-4578-b400-c36792cdc412 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:29.979651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41399b6e-b6e9-4578-b400-c36792cdc412 service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:29.989087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1074/2160] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:28:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:28:30.120041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5fe7c-1995-43c1-a1cf-069738e62231 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:30.121607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-adb5fe7c-1995-43c1-a1cf-069738e62231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:30.142929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5fe7c-1995-43c1-a1cf-069738e62231 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:30.156060 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:30.157190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:30.157668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:30.158165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] PATH_INFO: `/v3/projects/6b9574f7d2314b0e99aa578f9bd0d767` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:30.159738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9574f7d2314b0e99aa578f9bd0d767)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:30.162614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:30.263187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9574f7d2314b0e99aa578f9bd0d767', 'request_id': 'req-6b09a69c-d73d-441d-af01-41c0ce56c9a7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:30.269852 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9574f7d2314b0e99aa578f9bd0d767', 'request_id': 'req-6b09a69c-d73d-441d-af01-41c0ce56c9a7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:30.367596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9574f7d2314b0e99aa578f9bd0d767', 'request_id': 'req-6b09a69c-d73d-441d-af01-41c0ce56c9a7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:30.392438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] The token cache is being invalidate because project 6b9574f7d2314b0e99aa578f9bd0d767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:30.392844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:30.394233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:30.397630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1087/2161] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:30 2022] DELETE /identity/v3/projects/6b9574f7d2314b0e99aa578f9bd0d767 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:30.404539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd3b4b-187f-4d03-b016-8a1c9658c800 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:30.404954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd3b4b-187f-4d03-b016-8a1c9658c800 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:30.405030 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd3b4b-187f-4d03-b016-8a1c9658c800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:30.435630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-20dd3b4b-187f-4d03-b016-8a1c9658c800 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:30.436867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-20dd3b4b-187f-4d03-b016-8a1c9658c800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:30.522933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:30.528196 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:30.558062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1075/2162] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:30.560417 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a399-b143-4e2c-bed9-674234e932ef None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:30.560710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a399-b143-4e2c-bed9-674234e932ef None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:30.560992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a399-b143-4e2c-bed9-674234e932ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:30.602532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d5c1a399-b143-4e2c-bed9-674234e932ef None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:30.604413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d5c1a399-b143-4e2c-bed9-674234e932ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:30.617650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1076/2163] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:30.622100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1a399-b143-4e2c-bed9-674234e932ef None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:30.645651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1a399-b143-4e2c-bed9-674234e932ef None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:30.664630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f33771-a733-4819-ac89-bfdaa7062d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:30.665423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f33771-a733-4819-ac89-bfdaa7062d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:30.665704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f33771-a733-4819-ac89-bfdaa7062d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:30.665992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f33771-a733-4819-ac89-bfdaa7062d05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:30.669160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f33771-a733-4819-ac89-bfdaa7062d05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:30.669160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f33771-a733-4819-ac89-bfdaa7062d05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:30.686327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f33771-a733-4819-ac89-bfdaa7062d05 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:30.699704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09a69c-d73d-441d-af01-41c0ce56c9a7 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:30.706865 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:30.708368 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:30.708665 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:30.708953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] PATH_INFO: `/v3/projects/bca482db22de44b9b78b5545c1ed12a8` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:30.710238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca482db22de44b9b78b5545c1ed12a8)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:30.712251 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:30.714373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1077/2164] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:28:30.719754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f33771-a733-4819-ac89-bfdaa7062d05 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:30.754878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f33771-a733-4819-ac89-bfdaa7062d05 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:30.754878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b7ee5-aaaa-4986-8f00-ef3757c034ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:30.754878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b7ee5-aaaa-4986-8f00-ef3757c034ab admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:30.754878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b7ee5-aaaa-4986-8f00-ef3757c034ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:30.755447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b7ee5-aaaa-4986-8f00-ef3757c034ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:30.755447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b7ee5-aaaa-4986-8f00-ef3757c034ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:30.755795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b7ee5-aaaa-4986-8f00-ef3757c034ab admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:30.864062 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca482db22de44b9b78b5545c1ed12a8', 'request_id': 'req-47502ae4-d317-428e-8d54-7722e047cce8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:30.873464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca482db22de44b9b78b5545c1ed12a8', 'request_id': 'req-47502ae4-d317-428e-8d54-7722e047cce8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:30.885059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1078/2165] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:30 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:30.889476 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b7ee5-aaaa-4986-8f00-ef3757c034ab admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:30.964075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b7ee5-aaaa-4986-8f00-ef3757c034ab admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:30.969686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634745bb-8d33-40eb-86ec-66e54d0453f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:30.971165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634745bb-8d33-40eb-86ec-66e54d0453f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:30.971165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634745bb-8d33-40eb-86ec-66e54d0453f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:30.971165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634745bb-8d33-40eb-86ec-66e54d0453f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:30.974027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca482db22de44b9b78b5545c1ed12a8', 'request_id': 'req-47502ae4-d317-428e-8d54-7722e047cce8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:30.977137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634745bb-8d33-40eb-86ec-66e54d0453f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:30.978731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634745bb-8d33-40eb-86ec-66e54d0453f7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:31.004749 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] The token cache is being invalidate because project bca482db22de44b9b78b5545c1ed12a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:31.005132 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:31.005899 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:31.007632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1088/2166] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:30 2022] DELETE /identity/v3/projects/bca482db22de44b9b78b5545c1ed12a8 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:31.016581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:31.023395 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:31.068661 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1079/2167] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:30 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:31.072237 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634745bb-8d33-40eb-86ec-66e54d0453f7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:31.074317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-634745bb-8d33-40eb-86ec-66e54d0453f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:31.092846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634745bb-8d33-40eb-86ec-66e54d0453f7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:31.099608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f01f-c3cd-46aa-a6d3-5243fb796119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:31.100588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f01f-c3cd-46aa-a6d3-5243fb796119 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:31.101083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f01f-c3cd-46aa-a6d3-5243fb796119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:31.101559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f01f-c3cd-46aa-a6d3-5243fb796119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:31.102513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977f01f-c3cd-46aa-a6d3-5243fb796119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:31.104556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977f01f-c3cd-46aa-a6d3-5243fb796119 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:31.112834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502ae4-d317-428e-8d54-7722e047cce8 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:31.119638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:31.120605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:31.121268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:31.121761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] PATH_INFO: `/v3/users/eee37a53293649d29bcb1922b45cb131` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:31.123314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1080/2168] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:31.123654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee37a53293649d29bcb1922b45cb131)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:31.127725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:31.130565 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f01f-c3cd-46aa-a6d3-5243fb796119 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:31.152230 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f01f-c3cd-46aa-a6d3-5243fb796119 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:31.158391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76ccb6-50f3-4be6-b54a-81661d7a180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:31.159191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ccb6-50f3-4be6-b54a-81661d7a180b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:31.159554 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ccb6-50f3-4be6-b54a-81661d7a180b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:31.160443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ccb6-50f3-4be6-b54a-81661d7a180b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:31.161244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76ccb6-50f3-4be6-b54a-81661d7a180b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:31.163003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76ccb6-50f3-4be6-b54a-81661d7a180b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:31.173943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1081/2169] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:31.178547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76ccb6-50f3-4be6-b54a-81661d7a180b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:31.189643 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76ccb6-50f3-4be6-b54a-81661d7a180b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:31.194709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066b94d-3cdd-44da-9c59-988bb990d9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:31.195634 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b94d-3cdd-44da-9c59-988bb990d9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:31.195915 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b94d-3cdd-44da-9c59-988bb990d9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:31.196188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b94d-3cdd-44da-9c59-988bb990d9e1 admin admin] PATH_INFO: `/v3/projects/f6fceef0782240ccb486341a9007e4b0/users/e7d764501bed41d99941c6e083e19482/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:31.210989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066b94d-3cdd-44da-9c59-988bb990d9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6fceef0782240ccb486341a9007e4b0, user_id=e7d764501bed41d99941c6e083e19482, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:31.213871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066b94d-3cdd-44da-9c59-988bb990d9e1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:31.328829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1082/2170] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:31 2022] PUT /identity/v3/projects/f6fceef0782240ccb486341a9007e4b0/users/e7d764501bed41d99941c6e083e19482/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:31.333603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2128ff-bd63-4a6a-b3f5-36da655e9bd8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:31.334006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2128ff-bd63-4a6a-b3f5-36da655e9bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:31.334397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2128ff-bd63-4a6a-b3f5-36da655e9bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:31.358045 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-fa2128ff-bd63-4a6a-b3f5-36da655e9bd8 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:31.359400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fa2128ff-bd63-4a6a-b3f5-36da655e9bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:31.374113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee37a53293649d29bcb1922b45cb131'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:31.410515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee37a53293649d29bcb1922b45cb131'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:31.412713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee37a53293649d29bcb1922b45cb131'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:31.458943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1083/2171] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:31.471217 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2128ff-bd63-4a6a-b3f5-36da655e9bd8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:31.474261 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fa2128ff-bd63-4a6a-b3f5-36da655e9bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:31.490129 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee37a53293649d29bcb1922b45cb131'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:31.514293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee37a53293649d29bcb1922b45cb131'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:31.527998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1089/2172] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:31 2022] DELETE /identity/v3/users/eee37a53293649d29bcb1922b45cb131 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:31.598378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2128ff-bd63-4a6a-b3f5-36da655e9bd8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:31.698166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f328-74e5-4fb0-8f95-77ddce002300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:31.699313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f328-74e5-4fb0-8f95-77ddce002300 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:31.699809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f328-74e5-4fb0-8f95-77ddce002300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:31.700291 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f328-74e5-4fb0-8f95-77ddce002300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:31.702507 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0a84f328-74e5-4fb0-8f95-77ddce002300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:31.837553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84f328-74e5-4fb0-8f95-77ddce002300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:31.839201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84f328-74e5-4fb0-8f95-77ddce002300 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:31.850622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1084/2173] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:32.221756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:32.223465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:32.241244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc3e04-fc8a-4af6-aaf1-6c4e4a2beb31 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:32.246429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:32.247346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:32.247632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:32.248117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] PATH_INFO: `/v3/projects/e4b556337a674678bc71fc6c6f37d665` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:32.249773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b556337a674678bc71fc6c6f37d665)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:32.251873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:32.394492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b556337a674678bc71fc6c6f37d665', 'request_id': 'req-c829a18f-e596-4e84-917b-37ef234822ab'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:32.405307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b556337a674678bc71fc6c6f37d665', 'request_id': 'req-c829a18f-e596-4e84-917b-37ef234822ab'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:32.499310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b556337a674678bc71fc6c6f37d665', 'request_id': 'req-c829a18f-e596-4e84-917b-37ef234822ab'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:32.512999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] The token cache is being invalidate because project e4b556337a674678bc71fc6c6f37d665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:32.513230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:32.513849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:32.515936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1090/2174] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:32 2022] DELETE /identity/v3/projects/e4b556337a674678bc71fc6c6f37d665 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:32.520004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f328-74e5-4fb0-8f95-77ddce002300 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:32.530481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f328-74e5-4fb0-8f95-77ddce002300 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:32.604039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:32.605400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:32.605815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:32.606167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] PATH_INFO: `/v3/users/ed920733ae8e4ac289a8bf293e59bc00` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:32.607957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed920733ae8e4ac289a8bf293e59bc00)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:32.609991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:32.793186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed920733ae8e4ac289a8bf293e59bc00'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:32.806961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed920733ae8e4ac289a8bf293e59bc00'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:32.814327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed920733ae8e4ac289a8bf293e59bc00'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:32.815155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed920733ae8e4ac289a8bf293e59bc00'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:32.924017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed920733ae8e4ac289a8bf293e59bc00'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:32.937550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1085/2175] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:32 2022] DELETE /identity/v3/users/ed920733ae8e4ac289a8bf293e59bc00 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:33.105654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:33.107505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:33.135967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829a18f-e596-4e84-917b-37ef234822ab admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:33.241426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf720ed-ef97-4b9e-94a2-4e6d1d960d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:33.242415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf720ed-ef97-4b9e-94a2-4e6d1d960d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:33.242781 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf720ed-ef97-4b9e-94a2-4e6d1d960d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:33.243065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf720ed-ef97-4b9e-94a2-4e6d1d960d1a admin admin] PATH_INFO: `/v3/users/10e55f76eeaa46928289da220ceca447` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:33.244354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf720ed-ef97-4b9e-94a2-4e6d1d960d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e55f76eeaa46928289da220ceca447)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:33.246337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf720ed-ef97-4b9e-94a2-4e6d1d960d1a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:33.494602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-faf720ed-ef97-4b9e-94a2-4e6d1d960d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e55f76eeaa46928289da220ceca447'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:33.515337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-faf720ed-ef97-4b9e-94a2-4e6d1d960d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e55f76eeaa46928289da220ceca447'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:33.516335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-faf720ed-ef97-4b9e-94a2-4e6d1d960d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e55f76eeaa46928289da220ceca447'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:33.567419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:33.568094 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:33.587713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0990afd-aab0-422a-9b2e-314928a256e7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:33.594485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:33.595842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:33.603346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:33.603346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] PATH_INFO: `/v3/projects/e9bf0d96a2c54065bff7b7cc25f16ea8` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:33.603346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9bf0d96a2c54065bff7b7cc25f16ea8)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:33.603346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:33.615862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-faf720ed-ef97-4b9e-94a2-4e6d1d960d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e55f76eeaa46928289da220ceca447'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:33.632323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-faf720ed-ef97-4b9e-94a2-4e6d1d960d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e55f76eeaa46928289da220ceca447'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:33.645172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1091/2176] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:33 2022] DELETE /identity/v3/users/10e55f76eeaa46928289da220ceca447 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:33.647626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae9aeb-2546-4c7d-b4ad-cd96b7edbc4c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:33.648166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae9aeb-2546-4c7d-b4ad-cd96b7edbc4c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:33.648726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae9aeb-2546-4c7d-b4ad-cd96b7edbc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:33.686737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-80ae9aeb-2546-4c7d-b4ad-cd96b7edbc4c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:33.688957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-80ae9aeb-2546-4c7d-b4ad-cd96b7edbc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:33.726680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9bf0d96a2c54065bff7b7cc25f16ea8', 'request_id': 'req-a591217f-4fda-4902-975f-ff7927ab5c00'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:33.741056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9bf0d96a2c54065bff7b7cc25f16ea8', 'request_id': 'req-a591217f-4fda-4902-975f-ff7927ab5c00'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:33.780831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1092/2177] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:33.792305 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae9aeb-2546-4c7d-b4ad-cd96b7edbc4c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:33.794058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-80ae9aeb-2546-4c7d-b4ad-cd96b7edbc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:33.848391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9bf0d96a2c54065bff7b7cc25f16ea8', 'request_id': 'req-a591217f-4fda-4902-975f-ff7927ab5c00'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:33.863007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] The token cache is being invalidate because project e9bf0d96a2c54065bff7b7cc25f16ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:33.863173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:33.863887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a591217f-4fda-4902-975f-ff7927ab5c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:33.872829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1086/2178] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:33 2022] DELETE /identity/v3/projects/e9bf0d96a2c54065bff7b7cc25f16ea8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:33.875869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e192-084f-4a95-a247-d1e0bc87ed3b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:33.876159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e192-084f-4a95-a247-d1e0bc87ed3b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:33.876438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e192-084f-4a95-a247-d1e0bc87ed3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:33.906862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae9aeb-2546-4c7d-b4ad-cd96b7edbc4c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:33.952797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a0a0e192-084f-4a95-a247-d1e0bc87ed3b None None] MFA Rules not processed for user `e7d764501bed41d99941c6e083e19482`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:33.954089 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a0a0e192-084f-4a95-a247-d1e0bc87ed3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:34.007579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24519be3-fc47-45f1-bf11-8a5b14ac2c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:34.008351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24519be3-fc47-45f1-bf11-8a5b14ac2c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.012855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24519be3-fc47-45f1-bf11-8a5b14ac2c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.013192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24519be3-fc47-45f1-bf11-8a5b14ac2c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.019027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-24519be3-fc47-45f1-bf11-8a5b14ac2c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:34.090828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1087/2179] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:34.092138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ebac-e9d1-4c8e-8fc2-75605eb484f3 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.092425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ebac-e9d1-4c8e-8fc2-75605eb484f3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.093268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ebac-e9d1-4c8e-8fc2-75605eb484f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.129126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c1e2ebac-e9d1-4c8e-8fc2-75605eb484f3 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:34.130358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c1e2ebac-e9d1-4c8e-8fc2-75605eb484f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:34.139300 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24519be3-fc47-45f1-bf11-8a5b14ac2c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:34.140982 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24519be3-fc47-45f1-bf11-8a5b14ac2c93 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:34.142456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1088/2180] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:34.150787 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2ebac-e9d1-4c8e-8fc2-75605eb484f3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:34.155285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c1e2ebac-e9d1-4c8e-8fc2-75605eb484f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:34.161464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1093/2181] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:34.162704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b85ef9-651f-4295-9afe-0ccfd7a9ef30 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.163000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b85ef9-651f-4295-9afe-0ccfd7a9ef30 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.163315 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b85ef9-651f-4295-9afe-0ccfd7a9ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.181645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-b4b85ef9-651f-4295-9afe-0ccfd7a9ef30 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:34.182915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b4b85ef9-651f-4295-9afe-0ccfd7a9ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:34.207666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1094/2182] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:34.216760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b85ef9-651f-4295-9afe-0ccfd7a9ef30 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:34.240000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b85ef9-651f-4295-9afe-0ccfd7a9ef30 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:34.258985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783041c6-aa1f-4a0f-b112-2e0b44d437d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:34.259713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783041c6-aa1f-4a0f-b112-2e0b44d437d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.260000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783041c6-aa1f-4a0f-b112-2e0b44d437d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.260283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783041c6-aa1f-4a0f-b112-2e0b44d437d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.261086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783041c6-aa1f-4a0f-b112-2e0b44d437d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:34.261422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783041c6-aa1f-4a0f-b112-2e0b44d437d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:34.263104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783041c6-aa1f-4a0f-b112-2e0b44d437d8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:34.278936 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2ebac-e9d1-4c8e-8fc2-75605eb484f3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:34.280104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1095/2183] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:28:34.284995 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783041c6-aa1f-4a0f-b112-2e0b44d437d8 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:34.285908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22d71-d33f-46d1-b840-c65bfcba8833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:34.291147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22d71-d33f-46d1-b840-c65bfcba8833 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.291147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22d71-d33f-46d1-b840-c65bfcba8833 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.291147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22d71-d33f-46d1-b840-c65bfcba8833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.299442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e22d71-d33f-46d1-b840-c65bfcba8833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:34.301643 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e22d71-d33f-46d1-b840-c65bfcba8833 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:34.305697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783041c6-aa1f-4a0f-b112-2e0b44d437d8 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:34.312277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80509386-39bd-4350-8672-776a9e9566ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:34.312783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1089/2184] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:34.322198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80509386-39bd-4350-8672-776a9e9566ab admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.322198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80509386-39bd-4350-8672-776a9e9566ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.322198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80509386-39bd-4350-8672-776a9e9566ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.322554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80509386-39bd-4350-8672-776a9e9566ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:34.324640 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80509386-39bd-4350-8672-776a9e9566ab admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:34.418224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1096/2185] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:34 2022] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:34.419692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22d71-d33f-46d1-b840-c65bfcba8833 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:34.432362 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22d71-d33f-46d1-b840-c65bfcba8833 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:34.512689 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a660d-b365-400f-8086-1a64d2dd5c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:34.513446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a660d-b365-400f-8086-1a64d2dd5c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.513740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a660d-b365-400f-8086-1a64d2dd5c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.514074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a660d-b365-400f-8086-1a64d2dd5c1f admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.514782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a660d-b365-400f-8086-1a64d2dd5c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:34.517549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a660d-b365-400f-8086-1a64d2dd5c1f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:34.651690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80509386-39bd-4350-8672-776a9e9566ab admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:34.654170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-80509386-39bd-4350-8672-776a9e9566ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:34.674544 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1090/2186] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:34 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:34.681826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80509386-39bd-4350-8672-776a9e9566ab admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:34.683825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a660d-b365-400f-8086-1a64d2dd5c1f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:34.692073 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:34.692966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.693841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.694400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] PATH_INFO: `/v3/projects/1e8b971013bf492988f7119cf63c69bc` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.695490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8b971013bf492988f7119cf63c69bc)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:34.698255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a660d-b365-400f-8086-1a64d2dd5c1f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:34.698439 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:34.704475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cb346-394b-4f5c-b56d-cae05e8b2d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:34.709601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cb346-394b-4f5c-b56d-cae05e8b2d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.709601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cb346-394b-4f5c-b56d-cae05e8b2d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.709601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cb346-394b-4f5c-b56d-cae05e8b2d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.709601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cb346-394b-4f5c-b56d-cae05e8b2d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:34.717392 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cb346-394b-4f5c-b56d-cae05e8b2d03 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:34.734384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1091/2187] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:34.739203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cb346-394b-4f5c-b56d-cae05e8b2d03 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:34.752682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cb346-394b-4f5c-b56d-cae05e8b2d03 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:34.758929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6706d4e-54f3-4cb4-b987-d983deb466a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:34.759694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6706d4e-54f3-4cb4-b987-d983deb466a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.759975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6706d4e-54f3-4cb4-b987-d983deb466a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.760335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6706d4e-54f3-4cb4-b987-d983deb466a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.761814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6706d4e-54f3-4cb4-b987-d983deb466a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:34.764160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6706d4e-54f3-4cb4-b987-d983deb466a3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:34.782721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1092/2188] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:34.787596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6706d4e-54f3-4cb4-b987-d983deb466a3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:34.804739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6706d4e-54f3-4cb4-b987-d983deb466a3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:34.821138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8b971013bf492988f7119cf63c69bc', 'request_id': 'req-57124eec-3894-4762-b34e-11e815752e15'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:34.827716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8b971013bf492988f7119cf63c69bc', 'request_id': 'req-57124eec-3894-4762-b34e-11e815752e15'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:34.880298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829cb1a-7f2f-4d69-b91f-2eecedfe27c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:34.881384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829cb1a-7f2f-4d69-b91f-2eecedfe27c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.881688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829cb1a-7f2f-4d69-b91f-2eecedfe27c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.881938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829cb1a-7f2f-4d69-b91f-2eecedfe27c3 admin admin] PATH_INFO: `/v3/projects/5760f93083e345089e43b3a7ba765490/users/421c82cf34fe41c0a38b1660b93fbe31/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.904776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829cb1a-7f2f-4d69-b91f-2eecedfe27c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5760f93083e345089e43b3a7ba765490, user_id=421c82cf34fe41c0a38b1660b93fbe31, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:34.907905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829cb1a-7f2f-4d69-b91f-2eecedfe27c3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:34.912814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8b971013bf492988f7119cf63c69bc', 'request_id': 'req-57124eec-3894-4762-b34e-11e815752e15'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:34.926912 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] The token cache is being invalidate because project 1e8b971013bf492988f7119cf63c69bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:34.927316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:34.928026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-57124eec-3894-4762-b34e-11e815752e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:34.933776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1097/2189] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:34 2022] DELETE /identity/v3/projects/1e8b971013bf492988f7119cf63c69bc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:34.936250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972e9b-2f35-4f84-ac43-aba20acc658a None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:34.936400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972e9b-2f35-4f84-ac43-aba20acc658a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:34.936737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972e9b-2f35-4f84-ac43-aba20acc658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:34.968112 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f3972e9b-2f35-4f84-ac43-aba20acc658a None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:34.969637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f3972e9b-2f35-4f84-ac43-aba20acc658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:34.991270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1093/2190] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:34 2022] PUT /identity/v3/projects/5760f93083e345089e43b3a7ba765490/users/421c82cf34fe41c0a38b1660b93fbe31/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:34.998290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1098/2191] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:35.001493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44104419-47d6-4d7d-ac94-28dc47b52219 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.002084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44104419-47d6-4d7d-ac94-28dc47b52219 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.002428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44104419-47d6-4d7d-ac94-28dc47b52219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.006350 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25661f-72ea-4c7b-a458-6d7e5dcc6ee5 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.009846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25661f-72ea-4c7b-a458-6d7e5dcc6ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.009846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25661f-72ea-4c7b-a458-6d7e5dcc6ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.048090 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-44104419-47d6-4d7d-ac94-28dc47b52219 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:35.049432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-44104419-47d6-4d7d-ac94-28dc47b52219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:35.068085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-af25661f-72ea-4c7b-a458-6d7e5dcc6ee5 None None] MFA Rules not processed for user `421c82cf34fe41c0a38b1660b93fbe31`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:35.071736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-af25661f-72ea-4c7b-a458-6d7e5dcc6ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:35.175290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1094/2192] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:35.187955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44104419-47d6-4d7d-ac94-28dc47b52219 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:35.199490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44104419-47d6-4d7d-ac94-28dc47b52219 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:35.204649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98792ea1-f692-441a-b267-715cd14d4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:35.205427 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98792ea1-f692-441a-b267-715cd14d4b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.205713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98792ea1-f692-441a-b267-715cd14d4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.205989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98792ea1-f692-441a-b267-715cd14d4b49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.207425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98792ea1-f692-441a-b267-715cd14d4b49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:35.207883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98792ea1-f692-441a-b267-715cd14d4b49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:35.210135 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98792ea1-f692-441a-b267-715cd14d4b49 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:35.225438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1099/2193] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:35.226290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1095/2194] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:28:35.233444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd692c-4add-4ba0-ae95-33e49bce411c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.233925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd692c-4add-4ba0-ae95-33e49bce411c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.234470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd692c-4add-4ba0-ae95-33e49bce411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.235462 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98792ea1-f692-441a-b267-715cd14d4b49 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:35.247678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98792ea1-f692-441a-b267-715cd14d4b49 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:35.253330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0254cbd-da9d-4898-9d28-c04256037217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:35.253740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0254cbd-da9d-4898-9d28-c04256037217 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.254113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0254cbd-da9d-4898-9d28-c04256037217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.254432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0254cbd-da9d-4898-9d28-c04256037217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.255144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0254cbd-da9d-4898-9d28-c04256037217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:35.257211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0254cbd-da9d-4898-9d28-c04256037217 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:35.265802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-3ebd692c-4add-4ba0-ae95-33e49bce411c None None] MFA Rules not processed for user `a0294c57ba3f41bc8cf2cac294bb678c`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:35.267031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3ebd692c-4add-4ba0-ae95-33e49bce411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:35.333674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1100/2195] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:35.335264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd692c-4add-4ba0-ae95-33e49bce411c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:35.336603 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3ebd692c-4add-4ba0-ae95-33e49bce411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:35.387622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1096/2196] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:35 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:35.395559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b483-0998-4e9e-96d2-f618f2dfadc2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.397160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b483-0998-4e9e-96d2-f618f2dfadc2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.397604 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b483-0998-4e9e-96d2-f618f2dfadc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.404573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd692c-4add-4ba0-ae95-33e49bce411c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:35.418135 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8049b483-0998-4e9e-96d2-f618f2dfadc2 None None] MFA Rules not processed for user `a0294c57ba3f41bc8cf2cac294bb678c`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:35.419400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8049b483-0998-4e9e-96d2-f618f2dfadc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:35.462409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e016c-c163-4b8e-aee6-988d049767ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:35.463532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e016c-c163-4b8e-aee6-988d049767ab service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.464059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e016c-c163-4b8e-aee6-988d049767ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.468815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e016c-c163-4b8e-aee6-988d049767ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.519804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1097/2197] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:35.520867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049b483-0998-4e9e-96d2-f618f2dfadc2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:35.557495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e016c-c163-4b8e-aee6-988d049767ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:35.559015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e016c-c163-4b8e-aee6-988d049767ab service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:35.571730 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1101/2198] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:35.583779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e016c-c163-4b8e-aee6-988d049767ab service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:35.585872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-697e016c-c163-4b8e-aee6-988d049767ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:35.608590 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049b483-0998-4e9e-96d2-f618f2dfadc2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:35.614124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eadf2-9437-4a0a-be3c-5695bcf65456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:35.615302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eadf2-9437-4a0a-be3c-5695bcf65456 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.615603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eadf2-9437-4a0a-be3c-5695bcf65456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.615883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eadf2-9437-4a0a-be3c-5695bcf65456 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.616759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eadf2-9437-4a0a-be3c-5695bcf65456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:35.619820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eadf2-9437-4a0a-be3c-5695bcf65456 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:35.699689 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1098/2199] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:35 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:35.703796 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eadf2-9437-4a0a-be3c-5695bcf65456 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:35.708586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e016c-c163-4b8e-aee6-988d049767ab service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:35.716028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eadf2-9437-4a0a-be3c-5695bcf65456 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:35.723525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee73ed-662f-45e5-b7c5-221655466990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:35.724215 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee73ed-662f-45e5-b7c5-221655466990 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.733397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee73ed-662f-45e5-b7c5-221655466990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.733397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee73ed-662f-45e5-b7c5-221655466990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.733397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee73ed-662f-45e5-b7c5-221655466990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:35.733397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee73ed-662f-45e5-b7c5-221655466990 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:35.734050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62253b-4410-4a87-b117-225f11063cb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:35.734050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62253b-4410-4a87-b117-225f11063cb5 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.734050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62253b-4410-4a87-b117-225f11063cb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.734050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62253b-4410-4a87-b117-225f11063cb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.746207 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1099/2200] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:35.747332 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62253b-4410-4a87-b117-225f11063cb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:35.750165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee73ed-662f-45e5-b7c5-221655466990 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:35.753776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62253b-4410-4a87-b117-225f11063cb5 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:35.767775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee73ed-662f-45e5-b7c5-221655466990 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:35.774328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3722d-8dc5-4ac8-a764-a3045f7797f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:35.774997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3722d-8dc5-4ac8-a764-a3045f7797f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.775309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3722d-8dc5-4ac8-a764-a3045f7797f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.775585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3722d-8dc5-4ac8-a764-a3045f7797f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.776358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3722d-8dc5-4ac8-a764-a3045f7797f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:35.778265 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3722d-8dc5-4ac8-a764-a3045f7797f9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:35.783521 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1102/2201] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:35.794188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1100/2202] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:35.798192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62253b-4410-4a87-b117-225f11063cb5 service nova] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:35.815894 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62253b-4410-4a87-b117-225f11063cb5 service nova] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:35.825909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fe625-0fb4-4fe1-8fde-786e2f6e4203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:35.827003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fe625-0fb4-4fe1-8fde-786e2f6e4203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.827625 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fe625-0fb4-4fe1-8fde-786e2f6e4203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.827906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fe625-0fb4-4fe1-8fde-786e2f6e4203 admin admin] PATH_INFO: `/v3/projects/aff066fb75f04eb7bb9b16dea32b270d/users/bf8f7f47fe6c4a88b415ec21b36fcdd9/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:35.851325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fe625-0fb4-4fe1-8fde-786e2f6e4203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff066fb75f04eb7bb9b16dea32b270d, user_id=bf8f7f47fe6c4a88b415ec21b36fcdd9, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:35.854284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fe625-0fb4-4fe1-8fde-786e2f6e4203 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:35.951711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1103/2203] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:35 2022] PUT /identity/v3/projects/aff066fb75f04eb7bb9b16dea32b270d/users/bf8f7f47fe6c4a88b415ec21b36fcdd9/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:35.957287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d16b8-8198-40cc-9ec6-d91143f0fa36 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:35.957574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d16b8-8198-40cc-9ec6-d91143f0fa36 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:35.957848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d16b8-8198-40cc-9ec6-d91143f0fa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:36.031684 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-538d16b8-8198-40cc-9ec6-d91143f0fa36 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:36.032904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-538d16b8-8198-40cc-9ec6-d91143f0fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:36.169239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1101/2204] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:36.175576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fe625-0fb4-4fe1-8fde-786e2f6e4203 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:36.177358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e01fe625-0fb4-4fe1-8fde-786e2f6e4203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:36.292518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fe625-0fb4-4fe1-8fde-786e2f6e4203 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:36.297327 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff72230-cdd2-4366-92be-42d1705685f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:36.298038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff72230-cdd2-4366-92be-42d1705685f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:36.298324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff72230-cdd2-4366-92be-42d1705685f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:36.298603 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff72230-cdd2-4366-92be-42d1705685f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:36.308896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff72230-cdd2-4366-92be-42d1705685f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:36.310363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff72230-cdd2-4366-92be-42d1705685f2 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:36.321512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1104/2205] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:36.594769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d912-6e69-40b6-8e23-1c4947d8e52e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:36.595175 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d912-6e69-40b6-8e23-1c4947d8e52e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:36.595522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d912-6e69-40b6-8e23-1c4947d8e52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:36.619627 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-28e0d912-6e69-40b6-8e23-1c4947d8e52e None None] MFA Rules not processed for user `a0294c57ba3f41bc8cf2cac294bb678c`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:36.621027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-28e0d912-6e69-40b6-8e23-1c4947d8e52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:36.688183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1102/2206] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:37.198267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066f41-19e0-4d52-a199-44d326ef5c3e None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:37.198562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066f41-19e0-4d52-a199-44d326ef5c3e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:37.199008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066f41-19e0-4d52-a199-44d326ef5c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:37.218846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-81066f41-19e0-4d52-a199-44d326ef5c3e None None] MFA Rules not processed for user `e7d764501bed41d99941c6e083e19482`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:37.220347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-81066f41-19e0-4d52-a199-44d326ef5c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:37.357691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1105/2207] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:43.466009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5426-5685-47c4-9d63-56888ee9c5b1 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:43.466565 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5426-5685-47c4-9d63-56888ee9c5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:43.466565 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c5426-5685-47c4-9d63-56888ee9c5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:43.498880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d08c5426-5685-47c4-9d63-56888ee9c5b1 None None] MFA Rules not processed for user `bf8f7f47fe6c4a88b415ec21b36fcdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:43.500307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d08c5426-5685-47c4-9d63-56888ee9c5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:43.581079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1103/2208] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:43.586322 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81066f41-19e0-4d52-a199-44d326ef5c3e None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:43.632760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81066f41-19e0-4d52-a199-44d326ef5c3e None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:43.638409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a81749-417a-4112-a2c9-fbf5fac93bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:43.639666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a81749-417a-4112-a2c9-fbf5fac93bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:43.640325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a81749-417a-4112-a2c9-fbf5fac93bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:43.640901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a81749-417a-4112-a2c9-fbf5fac93bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:43.641774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a81749-417a-4112-a2c9-fbf5fac93bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:43.645002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a81749-417a-4112-a2c9-fbf5fac93bb5 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:43.729605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1106/2209] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:43 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:43.734046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c5426-5685-47c4-9d63-56888ee9c5b1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:43.744916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c5426-5685-47c4-9d63-56888ee9c5b1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:43.808478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a08b07-49c3-4e0c-9ec8-3d4112ceb77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:43.809194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a08b07-49c3-4e0c-9ec8-3d4112ceb77c admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:43.809641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a08b07-49c3-4e0c-9ec8-3d4112ceb77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:43.809925 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a08b07-49c3-4e0c-9ec8-3d4112ceb77c admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:43.810649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a08b07-49c3-4e0c-9ec8-3d4112ceb77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:43.812880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a08b07-49c3-4e0c-9ec8-3d4112ceb77c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:43.914204 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a81749-417a-4112-a2c9-fbf5fac93bb5 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:43.914953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1104/2210] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:43 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:43.926429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a81749-417a-4112-a2c9-fbf5fac93bb5 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:43.931900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a17b05-ce7d-46d9-af7a-12de0de6ac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:43.932585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a17b05-ce7d-46d9-af7a-12de0de6ac00 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:43.932916 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a17b05-ce7d-46d9-af7a-12de0de6ac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:43.933200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a17b05-ce7d-46d9-af7a-12de0de6ac00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:43.934159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a17b05-ce7d-46d9-af7a-12de0de6ac00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:43.935895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a17b05-ce7d-46d9-af7a-12de0de6ac00 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:43.948518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1107/2211] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:28:43.953140 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a08b07-49c3-4e0c-9ec8-3d4112ceb77c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:43.964866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a08b07-49c3-4e0c-9ec8-3d4112ceb77c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:43.970755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4242f5-70eb-421a-8017-33a19ce8adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:43.972134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4242f5-70eb-421a-8017-33a19ce8adbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:43.972530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4242f5-70eb-421a-8017-33a19ce8adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:43.972838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4242f5-70eb-421a-8017-33a19ce8adbf admin admin] PATH_INFO: `/v3/projects/c2d398586c0d470bb12b8fde402dfa0b/users/30fd99ac3599453fb10311cc1bbba403/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:43.993115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4242f5-70eb-421a-8017-33a19ce8adbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d398586c0d470bb12b8fde402dfa0b, user_id=30fd99ac3599453fb10311cc1bbba403, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:43.998461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4242f5-70eb-421a-8017-33a19ce8adbf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:44.122534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1105/2212] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:43 2022] PUT /identity/v3/projects/c2d398586c0d470bb12b8fde402dfa0b/users/30fd99ac3599453fb10311cc1bbba403/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:44.126503 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a17b05-ce7d-46d9-af7a-12de0de6ac00 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:44.137230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a17b05-ce7d-46d9-af7a-12de0de6ac00 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:44.195182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69418fb2-f11e-4904-a4c2-b279c2edace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:44.195720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69418fb2-f11e-4904-a4c2-b279c2edace8 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:44.196007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69418fb2-f11e-4904-a4c2-b279c2edace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:44.196287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69418fb2-f11e-4904-a4c2-b279c2edace8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:44.197041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69418fb2-f11e-4904-a4c2-b279c2edace8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:44.198653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69418fb2-f11e-4904-a4c2-b279c2edace8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:44.209266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1108/2213] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:44.213662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4242f5-70eb-421a-8017-33a19ce8adbf admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:44.232043 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4242f5-70eb-421a-8017-33a19ce8adbf admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:44.237458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0970940-407a-49f1-b005-0b6c5f05e85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:44.239167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0970940-407a-49f1-b005-0b6c5f05e85a admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:44.239467 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0970940-407a-49f1-b005-0b6c5f05e85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:44.239834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0970940-407a-49f1-b005-0b6c5f05e85a admin admin] PATH_INFO: `/v3/projects/c2d398586c0d470bb12b8fde402dfa0b/users/30fd99ac3599453fb10311cc1bbba403/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:44.242160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0970940-407a-49f1-b005-0b6c5f05e85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d398586c0d470bb12b8fde402dfa0b, user_id=30fd99ac3599453fb10311cc1bbba403, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:44.245022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0970940-407a-49f1-b005-0b6c5f05e85a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:44.257212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1106/2214] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:44 2022] PUT /identity/v3/projects/c2d398586c0d470bb12b8fde402dfa0b/users/30fd99ac3599453fb10311cc1bbba403/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:47.074186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69418fb2-f11e-4904-a4c2-b279c2edace8 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:47.075727 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-69418fb2-f11e-4904-a4c2-b279c2edace8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:47.091973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69418fb2-f11e-4904-a4c2-b279c2edace8 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:47.166614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444ad99-f892-4012-b367-193bd66e1378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:47.167733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444ad99-f892-4012-b367-193bd66e1378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:47.168225 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444ad99-f892-4012-b367-193bd66e1378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:47.168743 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444ad99-f892-4012-b367-193bd66e1378 admin admin] PATH_INFO: `/v3/users/0500a5a50de94794aea1e87bbe29223c` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:47.170195 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444ad99-f892-4012-b367-193bd66e1378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0500a5a50de94794aea1e87bbe29223c)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:47.172617 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444ad99-f892-4012-b367-193bd66e1378 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:47.409346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0970940-407a-49f1-b005-0b6c5f05e85a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:47.409346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f0970940-407a-49f1-b005-0b6c5f05e85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:47.473917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0970940-407a-49f1-b005-0b6c5f05e85a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:47.476468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6444ad99-f892-4012-b367-193bd66e1378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0500a5a50de94794aea1e87bbe29223c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:47.489335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:47.490334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:47.504397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:47.504397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] PATH_INFO: `/v3/users/421c82cf34fe41c0a38b1660b93fbe31` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:47.504397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=421c82cf34fe41c0a38b1660b93fbe31)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:47.504397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:47.513734 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6444ad99-f892-4012-b367-193bd66e1378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0500a5a50de94794aea1e87bbe29223c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:47.515814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6444ad99-f892-4012-b367-193bd66e1378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0500a5a50de94794aea1e87bbe29223c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:47.625585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6444ad99-f892-4012-b367-193bd66e1378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0500a5a50de94794aea1e87bbe29223c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:47.635981 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-6444ad99-f892-4012-b367-193bd66e1378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0500a5a50de94794aea1e87bbe29223c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:47.670676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1109/2215] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:47 2022] DELETE /identity/v3/users/0500a5a50de94794aea1e87bbe29223c => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:47.755734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421c82cf34fe41c0a38b1660b93fbe31'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:47.778191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421c82cf34fe41c0a38b1660b93fbe31'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:47.786640 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421c82cf34fe41c0a38b1660b93fbe31'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:47.788695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421c82cf34fe41c0a38b1660b93fbe31'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:47.933432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421c82cf34fe41c0a38b1660b93fbe31'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:47.940069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1107/2216] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:47 2022] DELETE /identity/v3/users/421c82cf34fe41c0a38b1660b93fbe31 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:28:47.946338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a3c91-5059-412f-b95f-41bc97d9eebc None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:47.946716 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a3c91-5059-412f-b95f-41bc97d9eebc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:47.947005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a3c91-5059-412f-b95f-41bc97d9eebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:47.972186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e44a3c91-5059-412f-b95f-41bc97d9eebc None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:47.973433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e44a3c91-5059-412f-b95f-41bc97d9eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:48.051309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1110/2217] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:48.062715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:48.065235 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:48.086152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a3c91-5059-412f-b95f-41bc97d9eebc None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:48.088158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e44a3c91-5059-412f-b95f-41bc97d9eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:48.104248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a3c91-5059-412f-b95f-41bc97d9eebc None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:48.118143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:48.119574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:48.120577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:48.121057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] PATH_INFO: `/v3/projects/5376211b192940d290e5de5b431d9255` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:48.122729 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5376211b192940d290e5de5b431d9255)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:48.126067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:48.155339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e29938-7738-4921-a15e-c927dfc18e7d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:48.159657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9e44-5f20-4a6e-b7d7-dda0d59f7b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:48.160376 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9e44-5f20-4a6e-b7d7-dda0d59f7b0a service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:48.160916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9e44-5f20-4a6e-b7d7-dda0d59f7b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:48.161550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9e44-5f20-4a6e-b7d7-dda0d59f7b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:48.172522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d9e44-5f20-4a6e-b7d7-dda0d59f7b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:48.174006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d9e44-5f20-4a6e-b7d7-dda0d59f7b0a service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:48.192130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1108/2218] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:48.264235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5376211b192940d290e5de5b431d9255', 'request_id': 'req-886e8bf7-877b-4d97-9073-f2ef7b81ada8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:48.281916 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5376211b192940d290e5de5b431d9255', 'request_id': 'req-886e8bf7-877b-4d97-9073-f2ef7b81ada8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:48.338981 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5376211b192940d290e5de5b431d9255', 'request_id': 'req-886e8bf7-877b-4d97-9073-f2ef7b81ada8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:48.358758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] The token cache is being invalidate because project 5376211b192940d290e5de5b431d9255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:48.359047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:48.360000 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:48.361547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1111/2219] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:48 2022] DELETE /identity/v3/projects/5376211b192940d290e5de5b431d9255 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:48.367297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9e44-5f20-4a6e-b7d7-dda0d59f7b0a service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:48.388494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9e44-5f20-4a6e-b7d7-dda0d59f7b0a service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:48.474907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c7358-4d6b-4f73-a37f-c49486d74470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:48.475720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c7358-4d6b-4f73-a37f-c49486d74470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:48.475943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c7358-4d6b-4f73-a37f-c49486d74470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:48.476212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c7358-4d6b-4f73-a37f-c49486d74470 admin admin] PATH_INFO: `/v3/users/fb1372d331674e588f1d9f45b6ef5b63` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:48.477923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c7358-4d6b-4f73-a37f-c49486d74470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1372d331674e588f1d9f45b6ef5b63)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:48.480425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c7358-4d6b-4f73-a37f-c49486d74470 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:48.742219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-924c7358-4d6b-4f73-a37f-c49486d74470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1372d331674e588f1d9f45b6ef5b63'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:48.759118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-924c7358-4d6b-4f73-a37f-c49486d74470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1372d331674e588f1d9f45b6ef5b63'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:48.774622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-924c7358-4d6b-4f73-a37f-c49486d74470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1372d331674e588f1d9f45b6ef5b63'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:48.774622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-924c7358-4d6b-4f73-a37f-c49486d74470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1372d331674e588f1d9f45b6ef5b63'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:48.801394 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:48.802863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:48.832154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e8bf7-877b-4d97-9073-f2ef7b81ada8 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:48.832154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:48.834616 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:48.835276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:48.835706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] PATH_INFO: `/v3/projects/5760f93083e345089e43b3a7ba765490` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:48.837258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5760f93083e345089e43b3a7ba765490)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:48.839813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:48.859616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-924c7358-4d6b-4f73-a37f-c49486d74470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1372d331674e588f1d9f45b6ef5b63'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:48.867764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1109/2220] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:48 2022] DELETE /identity/v3/users/fb1372d331674e588f1d9f45b6ef5b63 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:48.997783 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5760f93083e345089e43b3a7ba765490', 'request_id': 'req-c0482e1e-39f6-4192-95b2-36db97d647e8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:49.005698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5760f93083e345089e43b3a7ba765490', 'request_id': 'req-c0482e1e-39f6-4192-95b2-36db97d647e8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:49.093199 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5760f93083e345089e43b3a7ba765490', 'request_id': 'req-c0482e1e-39f6-4192-95b2-36db97d647e8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:49.107103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] The token cache is being invalidate because project 5760f93083e345089e43b3a7ba765490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:49.107860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:49.108964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c0482e1e-39f6-4192-95b2-36db97d647e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:49.110851 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1112/2221] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:48 2022] DELETE /identity/v3/projects/5760f93083e345089e43b3a7ba765490 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:49.115704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f38175-d7eb-4a4e-b411-e2d8a8b44726 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:49.118862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f38175-d7eb-4a4e-b411-e2d8a8b44726 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:49.119184 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f38175-d7eb-4a4e-b411-e2d8a8b44726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:49.184209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-09f38175-d7eb-4a4e-b411-e2d8a8b44726 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:49.186412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-09f38175-d7eb-4a4e-b411-e2d8a8b44726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:49.282623 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1110/2222] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:28:49.291068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad5c94-935f-4b29-940e-537ee8dc9f7f None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:49.291623 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad5c94-935f-4b29-940e-537ee8dc9f7f None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:49.292194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad5c94-935f-4b29-940e-537ee8dc9f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:49.322619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a5ad5c94-935f-4b29-940e-537ee8dc9f7f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:49.325499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a5ad5c94-935f-4b29-940e-537ee8dc9f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:49.340256 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f38175-d7eb-4a4e-b411-e2d8a8b44726 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:49.340364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1113/2223] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:49.351902 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f38175-d7eb-4a4e-b411-e2d8a8b44726 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:49.363544 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a743574-f3ea-4e5b-b44d-38b1af451459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:49.364330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a743574-f3ea-4e5b-b44d-38b1af451459 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:49.366709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a743574-f3ea-4e5b-b44d-38b1af451459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:49.367023 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a743574-f3ea-4e5b-b44d-38b1af451459 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:49.368243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a743574-f3ea-4e5b-b44d-38b1af451459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:49.368560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a743574-f3ea-4e5b-b44d-38b1af451459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:49.370479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a743574-f3ea-4e5b-b44d-38b1af451459 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:49.393747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1111/2224] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:28:49.395740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad5c94-935f-4b29-940e-537ee8dc9f7f None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:49.412347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad5c94-935f-4b29-940e-537ee8dc9f7f None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:49.419815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41ffca-500b-4385-8a2e-8b59dcece6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:49.420552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41ffca-500b-4385-8a2e-8b59dcece6fb admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:49.420975 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41ffca-500b-4385-8a2e-8b59dcece6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:49.421264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41ffca-500b-4385-8a2e-8b59dcece6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:49.422007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41ffca-500b-4385-8a2e-8b59dcece6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:49.425644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41ffca-500b-4385-8a2e-8b59dcece6fb admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:49.443592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a743574-f3ea-4e5b-b44d-38b1af451459 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:49.443592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8a743574-f3ea-4e5b-b44d-38b1af451459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:49.468723 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a743574-f3ea-4e5b-b44d-38b1af451459 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:49.486682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:49.489402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:49.489722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:49.491075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] PATH_INFO: `/v3/projects/094e03e200a0462face367f2ccbb3d9d` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:49.496794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=094e03e200a0462face367f2ccbb3d9d)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:49.505948 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:49.559712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1114/2225] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:49 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:49.564116 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41ffca-500b-4385-8a2e-8b59dcece6fb admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:49.657619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094e03e200a0462face367f2ccbb3d9d', 'request_id': 'req-7587836f-64f0-464a-8d5e-8051409ff7cc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:49.681415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094e03e200a0462face367f2ccbb3d9d', 'request_id': 'req-7587836f-64f0-464a-8d5e-8051409ff7cc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:49.684306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41ffca-500b-4385-8a2e-8b59dcece6fb admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:49.767738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094e03e200a0462face367f2ccbb3d9d', 'request_id': 'req-7587836f-64f0-464a-8d5e-8051409ff7cc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:49.797525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] The token cache is being invalidate because project 094e03e200a0462face367f2ccbb3d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:49.797840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:49.799592 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7587836f-64f0-464a-8d5e-8051409ff7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:49.810414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1112/2226] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:49 2022] DELETE /identity/v3/projects/094e03e200a0462face367f2ccbb3d9d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:49.815214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704518e-36bb-4d53-80ba-3a61ab2ffff9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:49.815506 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704518e-36bb-4d53-80ba-3a61ab2ffff9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:49.818009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704518e-36bb-4d53-80ba-3a61ab2ffff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:49.845442 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c26d64-31e4-4d02-ab50-2594b01401c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:49.848867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c26d64-31e4-4d02-ab50-2594b01401c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:49.849133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c26d64-31e4-4d02-ab50-2594b01401c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:49.849375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c26d64-31e4-4d02-ab50-2594b01401c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:49.852603 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c26d64-31e4-4d02-ab50-2594b01401c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:49.855502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c26d64-31e4-4d02-ab50-2594b01401c1 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:49.872258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3704518e-36bb-4d53-80ba-3a61ab2ffff9 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:49.873577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3704518e-36bb-4d53-80ba-3a61ab2ffff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:49.905466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1113/2227] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:49.908073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdd8e1-b5ce-4c49-8d76-c176fe3d9d47 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:49.908297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdd8e1-b5ce-4c49-8d76-c176fe3d9d47 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:49.908611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdd8e1-b5ce-4c49-8d76-c176fe3d9d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:49.937520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-81fdd8e1-b5ce-4c49-8d76-c176fe3d9d47 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:49.938903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-81fdd8e1-b5ce-4c49-8d76-c176fe3d9d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:49.975975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1114/2228] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:49.977248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdd8e1-b5ce-4c49-8d76-c176fe3d9d47 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:49.994996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdd8e1-b5ce-4c49-8d76-c176fe3d9d47 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:50.013487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1115/2229] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:49 2022] POST /identity/v3/users => generated 287 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:50.014748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c26d64-31e4-4d02-ab50-2594b01401c1 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:50.019470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c1c26d64-31e4-4d02-ab50-2594b01401c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:50.026615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b88dd-965a-40ef-913a-4629188222de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:50.027897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b88dd-965a-40ef-913a-4629188222de admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:50.031076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b88dd-965a-40ef-913a-4629188222de admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:50.035074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b88dd-965a-40ef-913a-4629188222de admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:50.035074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b88dd-965a-40ef-913a-4629188222de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:28:50.035074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b88dd-965a-40ef-913a-4629188222de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:50.045228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b88dd-965a-40ef-913a-4629188222de admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:50.069718 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c26d64-31e4-4d02-ab50-2594b01401c1 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:50.087928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1115/2230] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:28:50.098106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b88dd-965a-40ef-913a-4629188222de admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:50.100151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d1cbd-0ec2-41c2-9b1c-73a3a964a583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:50.101424 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d1cbd-0ec2-41c2-9b1c-73a3a964a583 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:50.103686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d1cbd-0ec2-41c2-9b1c-73a3a964a583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:50.103686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d1cbd-0ec2-41c2-9b1c-73a3a964a583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:50.103686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d1cbd-0ec2-41c2-9b1c-73a3a964a583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:50.104655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d1cbd-0ec2-41c2-9b1c-73a3a964a583 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:50.133168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b88dd-965a-40ef-913a-4629188222de admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:50.136405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1116/2231] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:50.143062 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d1cbd-0ec2-41c2-9b1c-73a3a964a583 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:50.155150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787f3a9-576d-4c21-92f4-e0dafa4b2ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:50.155894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787f3a9-576d-4c21-92f4-e0dafa4b2ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:50.156185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787f3a9-576d-4c21-92f4-e0dafa4b2ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:50.156506 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787f3a9-576d-4c21-92f4-e0dafa4b2ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:50.157164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787f3a9-576d-4c21-92f4-e0dafa4b2ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:50.159207 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787f3a9-576d-4c21-92f4-e0dafa4b2ec0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:50.167710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d1cbd-0ec2-41c2-9b1c-73a3a964a583 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:50.185034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ca02f-48ad-4bd3-958a-2f3093ca9d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:50.186017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ca02f-48ad-4bd3-958a-2f3093ca9d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:50.186464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ca02f-48ad-4bd3-958a-2f3093ca9d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:50.186891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ca02f-48ad-4bd3-958a-2f3093ca9d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:50.187910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ca02f-48ad-4bd3-958a-2f3093ca9d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:50.191959 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ca02f-48ad-4bd3-958a-2f3093ca9d64 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:50.222074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1117/2232] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:50.226428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ca02f-48ad-4bd3-958a-2f3093ca9d64 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:50.260624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ca02f-48ad-4bd3-958a-2f3093ca9d64 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:50.270297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fd9e2-1b63-46e6-8483-eee9fbb96d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:50.272400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fd9e2-1b63-46e6-8483-eee9fbb96d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:50.272908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fd9e2-1b63-46e6-8483-eee9fbb96d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:50.273627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fd9e2-1b63-46e6-8483-eee9fbb96d6a admin admin] PATH_INFO: `/v3/projects/15f2d05b5ad248009d2acb0d3db6aec9/users/72919bd9efe84fa8acf2b407d7b6b13d/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:50.289515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1116/2233] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:50 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:50.298521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787f3a9-576d-4c21-92f4-e0dafa4b2ec0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:50.302280 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fd9e2-1b63-46e6-8483-eee9fbb96d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f2d05b5ad248009d2acb0d3db6aec9, user_id=72919bd9efe84fa8acf2b407d7b6b13d, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:50.316405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fd9e2-1b63-46e6-8483-eee9fbb96d6a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:50.412208 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1118/2234] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:50 2022] PUT /identity/v3/projects/15f2d05b5ad248009d2acb0d3db6aec9/users/72919bd9efe84fa8acf2b407d7b6b13d/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:50.414252 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c149897-17a3-464a-917c-708f495b2fcf None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:50.416459 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c149897-17a3-464a-917c-708f495b2fcf None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:50.416928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c149897-17a3-464a-917c-708f495b2fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:50.432554 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787f3a9-576d-4c21-92f4-e0dafa4b2ec0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:50.475747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-7c149897-17a3-464a-917c-708f495b2fcf None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:50.480227 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7c149897-17a3-464a-917c-708f495b2fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:50.564863 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e37afc-6ea6-48be-8a85-048ac2318054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:50.565662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e37afc-6ea6-48be-8a85-048ac2318054 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:50.566742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e37afc-6ea6-48be-8a85-048ac2318054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:50.567029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e37afc-6ea6-48be-8a85-048ac2318054 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:50.567888 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e37afc-6ea6-48be-8a85-048ac2318054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:50.569882 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e37afc-6ea6-48be-8a85-048ac2318054 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:50.664956 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1119/2235] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:50.686714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c149897-17a3-464a-917c-708f495b2fcf None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:50.689805 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7c149897-17a3-464a-917c-708f495b2fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:50.711641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1117/2236] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:50 2022] POST /identity/v3/users => generated 286 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:28:50.724277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e37afc-6ea6-48be-8a85-048ac2318054 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:50.742033 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e37afc-6ea6-48be-8a85-048ac2318054 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:50.747615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd98552-256f-45df-bc23-b64816d89786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:50.754112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd98552-256f-45df-bc23-b64816d89786 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:50.754112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd98552-256f-45df-bc23-b64816d89786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:50.754112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd98552-256f-45df-bc23-b64816d89786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:50.754112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd98552-256f-45df-bc23-b64816d89786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:50.754112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd98552-256f-45df-bc23-b64816d89786 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:50.773772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1118/2237] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:50.784251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd98552-256f-45df-bc23-b64816d89786 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:50.801109 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd98552-256f-45df-bc23-b64816d89786 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:50.813064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d539999-3ce4-4861-a295-c8c02752c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:50.813761 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d539999-3ce4-4861-a295-c8c02752c156 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:50.814042 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d539999-3ce4-4861-a295-c8c02752c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:50.814303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d539999-3ce4-4861-a295-c8c02752c156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:50.815092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d539999-3ce4-4861-a295-c8c02752c156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:50.817243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d539999-3ce4-4861-a295-c8c02752c156 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:50.848764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1119/2238] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:50.850081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d539999-3ce4-4861-a295-c8c02752c156 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:50.862293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c149897-17a3-464a-917c-708f495b2fcf None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:50.872396 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d539999-3ce4-4861-a295-c8c02752c156 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:50.874017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153daeec-6816-463d-b39e-4c7a36274642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:50.874694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153daeec-6816-463d-b39e-4c7a36274642 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:50.874981 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153daeec-6816-463d-b39e-4c7a36274642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:50.875289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153daeec-6816-463d-b39e-4c7a36274642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:50.887423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc6201-7123-49ec-8425-bd19ee13bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:50.888319 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6201-7123-49ec-8425-bd19ee13bcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:50.888606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6201-7123-49ec-8425-bd19ee13bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:50.888893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6201-7123-49ec-8425-bd19ee13bcbb admin admin] PATH_INFO: `/v3/projects/95eb0e6ed4f0452c97091724dbf11a1d/users/9fc7f41320d1440584364ae8f31fe7fb/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:50.898177 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153daeec-6816-463d-b39e-4c7a36274642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:50.904213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153daeec-6816-463d-b39e-4c7a36274642 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:50.919290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1120/2239] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:28:50.929963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc6201-7123-49ec-8425-bd19ee13bcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=95eb0e6ed4f0452c97091724dbf11a1d, user_id=9fc7f41320d1440584364ae8f31fe7fb, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:50.934108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc6201-7123-49ec-8425-bd19ee13bcbb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:51.013603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1120/2240] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:50 2022] PUT /identity/v3/projects/95eb0e6ed4f0452c97091724dbf11a1d/users/9fc7f41320d1440584364ae8f31fe7fb/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:51.029454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20f77-e6e5-4f0d-b4fc-dd6e30f5496b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:51.030016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20f77-e6e5-4f0d-b4fc-dd6e30f5496b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:51.030475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea20f77-e6e5-4f0d-b4fc-dd6e30f5496b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:51.106007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-8ea20f77-e6e5-4f0d-b4fc-dd6e30f5496b None None] MFA Rules not processed for user `9fc7f41320d1440584364ae8f31fe7fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:51.109767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8ea20f77-e6e5-4f0d-b4fc-dd6e30f5496b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:51.218536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1121/2241] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:51.224243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc6201-7123-49ec-8425-bd19ee13bcbb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:51.340130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc6201-7123-49ec-8425-bd19ee13bcbb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:51.346940 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96377a3d-f46a-4732-b6b4-b0ae0e72a0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:51.349195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96377a3d-f46a-4732-b6b4-b0ae0e72a0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:51.349699 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96377a3d-f46a-4732-b6b4-b0ae0e72a0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:51.350196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96377a3d-f46a-4732-b6b4-b0ae0e72a0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:51.351192 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96377a3d-f46a-4732-b6b4-b0ae0e72a0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:51.354538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96377a3d-f46a-4732-b6b4-b0ae0e72a0a9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:51.497002 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1121/2242] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:28:51 2022] POST /identity/v3/projects => generated 373 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:51.501262 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea20f77-e6e5-4f0d-b4fc-dd6e30f5496b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:51.537905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea20f77-e6e5-4f0d-b4fc-dd6e30f5496b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:51.701257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40909b6-1f64-4337-bc28-bbf6a0525419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:51.703518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40909b6-1f64-4337-bc28-bbf6a0525419 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:51.705243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40909b6-1f64-4337-bc28-bbf6a0525419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:51.706644 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40909b6-1f64-4337-bc28-bbf6a0525419 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:51.708301 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40909b6-1f64-4337-bc28-bbf6a0525419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:51.711765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40909b6-1f64-4337-bc28-bbf6a0525419 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:51.802826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1122/2243] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:28:51 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:28:51.806618 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96377a3d-f46a-4732-b6b4-b0ae0e72a0a9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:51.824822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96377a3d-f46a-4732-b6b4-b0ae0e72a0a9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:51.831112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480e2e8-2861-4f51-af41-d08a41c06f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:51.832171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e2e8-2861-4f51-af41-d08a41c06f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:51.832609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e2e8-2861-4f51-af41-d08a41c06f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:51.833291 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e2e8-2861-4f51-af41-d08a41c06f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:51.834576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480e2e8-2861-4f51-af41-d08a41c06f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:51.836695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480e2e8-2861-4f51-af41-d08a41c06f34 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:51.876594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1122/2244] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:51.881022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40909b6-1f64-4337-bc28-bbf6a0525419 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:51.893122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40909b6-1f64-4337-bc28-bbf6a0525419 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:51.900163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479f8dd-05dd-410a-8cfd-01b5e55fbcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:51.901353 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479f8dd-05dd-410a-8cfd-01b5e55fbcd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:51.901982 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479f8dd-05dd-410a-8cfd-01b5e55fbcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:51.902615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479f8dd-05dd-410a-8cfd-01b5e55fbcd7 admin admin] PATH_INFO: `/v3/projects/d427ab0437d844f8be6b3846e2ea71b2/users/388ffef4a5c84247ba57470348ecd57e/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:51.925946 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479f8dd-05dd-410a-8cfd-01b5e55fbcd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d427ab0437d844f8be6b3846e2ea71b2, user_id=388ffef4a5c84247ba57470348ecd57e, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:51.930557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479f8dd-05dd-410a-8cfd-01b5e55fbcd7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:52.073671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1123/2245] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:51 2022] PUT /identity/v3/projects/d427ab0437d844f8be6b3846e2ea71b2/users/388ffef4a5c84247ba57470348ecd57e/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:52.077740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480e2e8-2861-4f51-af41-d08a41c06f34 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:52.090584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480e2e8-2861-4f51-af41-d08a41c06f34 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:52.200852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924a440-df17-4211-87ba-53adbbc7e365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:52.201683 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924a440-df17-4211-87ba-53adbbc7e365 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:52.202064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924a440-df17-4211-87ba-53adbbc7e365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:52.203097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924a440-df17-4211-87ba-53adbbc7e365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:52.204642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924a440-df17-4211-87ba-53adbbc7e365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:52.210212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924a440-df17-4211-87ba-53adbbc7e365 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:52.239270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479f8dd-05dd-410a-8cfd-01b5e55fbcd7 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:52.239744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1123/2246] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:28:52.258834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479f8dd-05dd-410a-8cfd-01b5e55fbcd7 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:52.266156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007415f-fad1-4fd9-8874-ab7d0b4b28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:52.267371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007415f-fad1-4fd9-8874-ab7d0b4b28d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:52.267705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007415f-fad1-4fd9-8874-ab7d0b4b28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:52.268346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007415f-fad1-4fd9-8874-ab7d0b4b28d4 admin admin] PATH_INFO: `/v3/projects/d427ab0437d844f8be6b3846e2ea71b2/users/388ffef4a5c84247ba57470348ecd57e/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:52.272971 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007415f-fad1-4fd9-8874-ab7d0b4b28d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d427ab0437d844f8be6b3846e2ea71b2, user_id=388ffef4a5c84247ba57470348ecd57e, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:52.276650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007415f-fad1-4fd9-8874-ab7d0b4b28d4 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:52.303040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f788-9d99-46f9-8da9-3979801505b9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:52.303585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f788-9d99-46f9-8da9-3979801505b9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:52.303764 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1124/2247] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:28:52 2022] PUT /identity/v3/projects/d427ab0437d844f8be6b3846e2ea71b2/users/388ffef4a5c84247ba57470348ecd57e/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:52.304053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f788-9d99-46f9-8da9-3979801505b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:52.405219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c066f788-9d99-46f9-8da9-3979801505b9 None None] MFA Rules not processed for user `388ffef4a5c84247ba57470348ecd57e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:52.425511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c066f788-9d99-46f9-8da9-3979801505b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:52.610059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1124/2248] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:52.629763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007415f-fad1-4fd9-8874-ab7d0b4b28d4 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:52.632036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d007415f-fad1-4fd9-8874-ab7d0b4b28d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:52.712895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007415f-fad1-4fd9-8874-ab7d0b4b28d4 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:52.723490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01a2a2-c82c-4d2e-8e63-957f44f71913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:52.726590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01a2a2-c82c-4d2e-8e63-957f44f71913 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:52.727023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01a2a2-c82c-4d2e-8e63-957f44f71913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:52.727464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01a2a2-c82c-4d2e-8e63-957f44f71913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:52.827922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01a2a2-c82c-4d2e-8e63-957f44f71913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:52.829697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01a2a2-c82c-4d2e-8e63-957f44f71913 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:52.846170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1125/2249] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:53.879498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206efb2-d29e-4eae-a1db-b5f0f44ef204 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:53.879959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206efb2-d29e-4eae-a1db-b5f0f44ef204 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:53.880073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206efb2-d29e-4eae-a1db-b5f0f44ef204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:53.957828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b206efb2-d29e-4eae-a1db-b5f0f44ef204 None None] MFA Rules not processed for user `30fd99ac3599453fb10311cc1bbba403`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:53.959309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b206efb2-d29e-4eae-a1db-b5f0f44ef204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:54.070552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1125/2250] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:54.087009 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01a2a2-c82c-4d2e-8e63-957f44f71913 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:54.089581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7b01a2a2-c82c-4d2e-8e63-957f44f71913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:54.188176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01a2a2-c82c-4d2e-8e63-957f44f71913 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:54.192367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4ac8c-9ad1-42ff-83ed-d2ab79edff8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e00de466abe41da8e6d7dbbd71f5270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:54.193370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4ac8c-9ad1-42ff-83ed-d2ab79edff8a service glance] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:54.193844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4ac8c-9ad1-42ff-83ed-d2ab79edff8a service glance] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:54.194281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4ac8c-9ad1-42ff-83ed-d2ab79edff8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:54.196517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-30e4ac8c-9ad1-42ff-83ed-d2ab79edff8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:54.268508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4ac8c-9ad1-42ff-83ed-d2ab79edff8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:54.271861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4ac8c-9ad1-42ff-83ed-d2ab79edff8a service glance] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:54.286597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1126/2251] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:54.537378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567bb24-7634-4cd6-b78f-890fcdfdb4b6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:54.537744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567bb24-7634-4cd6-b78f-890fcdfdb4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:54.538092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567bb24-7634-4cd6-b78f-890fcdfdb4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:54.572903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5567bb24-7634-4cd6-b78f-890fcdfdb4b6 None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:54.574395 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5567bb24-7634-4cd6-b78f-890fcdfdb4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:54.650742 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1126/2252] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:28:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:54.664857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4ac8c-9ad1-42ff-83ed-d2ab79edff8a service glance] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:54.666340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-30e4ac8c-9ad1-42ff-83ed-d2ab79edff8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:54.749834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4ac8c-9ad1-42ff-83ed-d2ab79edff8a service glance] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:54.756033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd50991-bc5b-4b4b-9399-33276871d0c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:54.756845 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd50991-bc5b-4b4b-9399-33276871d0c6 service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:54.757137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd50991-bc5b-4b4b-9399-33276871d0c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:54.757411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd50991-bc5b-4b4b-9399-33276871d0c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:54.768311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd50991-bc5b-4b4b-9399-33276871d0c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:54.770631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd50991-bc5b-4b4b-9399-33276871d0c6 service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:54.783729 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1127/2253] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:28:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:28:57.558425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567bb24-7634-4cd6-b78f-890fcdfdb4b6 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:57.700786 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567bb24-7634-4cd6-b78f-890fcdfdb4b6 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:57.713519 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:57.714383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:57.714662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:57.714945 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] PATH_INFO: `/v3/users/9fc7f41320d1440584364ae8f31fe7fb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:57.717907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc7f41320d1440584364ae8f31fe7fb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:57.726208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:58.087290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc7f41320d1440584364ae8f31fe7fb'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:58.122273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc7f41320d1440584364ae8f31fe7fb'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:58.139842 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc7f41320d1440584364ae8f31fe7fb'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:58.140846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc7f41320d1440584364ae8f31fe7fb'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:58.218799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc7f41320d1440584364ae8f31fe7fb'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:58.227014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1127/2254] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:57 2022] DELETE /identity/v3/users/9fc7f41320d1440584364ae8f31fe7fb => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:58.231367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b78e2c-a4fd-4e93-b856-703b0d1feb0c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:58.232366 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b78e2c-a4fd-4e93-b856-703b0d1feb0c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:58.232907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b78e2c-a4fd-4e93-b856-703b0d1feb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:58.268388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-28b78e2c-a4fd-4e93-b856-703b0d1feb0c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:28:58.270158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-28b78e2c-a4fd-4e93-b856-703b0d1feb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:58.421181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1128/2255] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:28:58.460606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:58.462401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:58.603491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342b399-da29-4408-a96c-c1a0dd3e47c4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:58.617986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340227b1-f298-449c-b502-1e376adf22ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:58.620761 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340227b1-f298-449c-b502-1e376adf22ac service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:58.622810 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340227b1-f298-449c-b502-1e376adf22ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:58.623723 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340227b1-f298-449c-b502-1e376adf22ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:58.651065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340227b1-f298-449c-b502-1e376adf22ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:58.653254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340227b1-f298-449c-b502-1e376adf22ac service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:58.671032 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1128/2256] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:28:59.497111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b78e2c-a4fd-4e93-b856-703b0d1feb0c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:59.499624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-28b78e2c-a4fd-4e93-b856-703b0d1feb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:28:59.555106 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b78e2c-a4fd-4e93-b856-703b0d1feb0c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:28:59.561358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:28:59.562692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:28:59.563159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:28:59.564521 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] PATH_INFO: `/v3/projects/95eb0e6ed4f0452c97091724dbf11a1d` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:28:59.566034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95eb0e6ed4f0452c97091724dbf11a1d)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:28:59.568188 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:28:59.724463 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95eb0e6ed4f0452c97091724dbf11a1d', 'request_id': 'req-883a1764-2fb3-4989-bfc1-ff558c29ce93'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:59.743407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95eb0e6ed4f0452c97091724dbf11a1d', 'request_id': 'req-883a1764-2fb3-4989-bfc1-ff558c29ce93'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:59.854875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95eb0e6ed4f0452c97091724dbf11a1d', 'request_id': 'req-883a1764-2fb3-4989-bfc1-ff558c29ce93'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:59.886664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] The token cache is being invalidate because project 95eb0e6ed4f0452c97091724dbf11a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:28:59.887213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:59.887904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:28:59.891168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1129/2257] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:28:59 2022] DELETE /identity/v3/projects/95eb0e6ed4f0452c97091724dbf11a1d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:28:59.893573 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340227b1-f298-449c-b502-1e376adf22ac service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:28:59.925980 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340227b1-f298-449c-b502-1e376adf22ac service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:00.161979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c555ba-8f9d-43b8-990a-51f1b9022a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:00.172138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c555ba-8f9d-43b8-990a-51f1b9022a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:00.172659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c555ba-8f9d-43b8-990a-51f1b9022a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:00.173095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c555ba-8f9d-43b8-990a-51f1b9022a48 admin admin] PATH_INFO: `/v3/users/388ffef4a5c84247ba57470348ecd57e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:00.188798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c555ba-8f9d-43b8-990a-51f1b9022a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388ffef4a5c84247ba57470348ecd57e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:00.191398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c555ba-8f9d-43b8-990a-51f1b9022a48 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:00.494847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-97c555ba-8f9d-43b8-990a-51f1b9022a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388ffef4a5c84247ba57470348ecd57e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:00.528066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-97c555ba-8f9d-43b8-990a-51f1b9022a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388ffef4a5c84247ba57470348ecd57e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:00.544259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-97c555ba-8f9d-43b8-990a-51f1b9022a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388ffef4a5c84247ba57470348ecd57e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:00.547732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-97c555ba-8f9d-43b8-990a-51f1b9022a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388ffef4a5c84247ba57470348ecd57e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:00.664683 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-97c555ba-8f9d-43b8-990a-51f1b9022a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388ffef4a5c84247ba57470348ecd57e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:00.674500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1129/2258] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:28:59 2022] DELETE /identity/v3/users/388ffef4a5c84247ba57470348ecd57e => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:29:01.746290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:01.747970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:01.777610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a1764-2fb3-4989-bfc1-ff558c29ce93 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:01.908075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:01.909053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:01.909442 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:01.909799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] PATH_INFO: `/v3/projects/d427ab0437d844f8be6b3846e2ea71b2` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:01.911440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d427ab0437d844f8be6b3846e2ea71b2)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:01.917185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:02.113258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd427ab0437d844f8be6b3846e2ea71b2', 'request_id': 'req-5f3fdadc-d0ea-455b-8f33-db32059c816a'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:02.119730 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd427ab0437d844f8be6b3846e2ea71b2', 'request_id': 'req-5f3fdadc-d0ea-455b-8f33-db32059c816a'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:02.193228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712ea8-1e3e-4e57-8b1e-3472afb15243 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:02.194314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712ea8-1e3e-4e57-8b1e-3472afb15243 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:02.194832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712ea8-1e3e-4e57-8b1e-3472afb15243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:02.213746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd427ab0437d844f8be6b3846e2ea71b2', 'request_id': 'req-5f3fdadc-d0ea-455b-8f33-db32059c816a'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:02.233163 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] The token cache is being invalidate because project d427ab0437d844f8be6b3846e2ea71b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:29:02.235651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:02.239562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5f3fdadc-d0ea-455b-8f33-db32059c816a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:02.242122 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9a712ea8-1e3e-4e57-8b1e-3472afb15243 None None] MFA Rules not processed for user `72919bd9efe84fa8acf2b407d7b6b13d`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:02.242453 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1130/2259] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:29:01 2022] DELETE /identity/v3/projects/d427ab0437d844f8be6b3846e2ea71b2 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:29:02.248274 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd390794-1d1c-4f96-abb8-b297718ba1e5 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:02.248795 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd390794-1d1c-4f96-abb8-b297718ba1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:02.249306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd390794-1d1c-4f96-abb8-b297718ba1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:02.254651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9a712ea8-1e3e-4e57-8b1e-3472afb15243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:02.305093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-cd390794-1d1c-4f96-abb8-b297718ba1e5 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:02.308035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-cd390794-1d1c-4f96-abb8-b297718ba1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:02.350069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1130/2260] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:29:02.354922 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712ea8-1e3e-4e57-8b1e-3472afb15243 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:02.356633 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9a712ea8-1e3e-4e57-8b1e-3472afb15243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:02.460813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1131/2261] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:02.468386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f1b2-eac6-4799-89e3-7e92c5947484 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:02.468676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f1b2-eac6-4799-89e3-7e92c5947484 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:02.468957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f1b2-eac6-4799-89e3-7e92c5947484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:02.492883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712ea8-1e3e-4e57-8b1e-3472afb15243 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:02.503606 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9461db-a08c-4a87-a474-874750fecdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:02.504567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9461db-a08c-4a87-a474-874750fecdb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:02.505031 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9461db-a08c-4a87-a474-874750fecdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:02.505778 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9461db-a08c-4a87-a474-874750fecdb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:02.508418 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9461db-a08c-4a87-a474-874750fecdb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:02.512010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-cd87f1b2-eac6-4799-89e3-7e92c5947484 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:02.513287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-cd87f1b2-eac6-4799-89e3-7e92c5947484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:02.514716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9461db-a08c-4a87-a474-874750fecdb4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:02.533167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1132/2262] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:02.534373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87f1b2-eac6-4799-89e3-7e92c5947484 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:02.556302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87f1b2-eac6-4799-89e3-7e92c5947484 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:02.561173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff91ac-03c4-482c-8d7f-26145725991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:02.562041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff91ac-03c4-482c-8d7f-26145725991b admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:02.562329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff91ac-03c4-482c-8d7f-26145725991b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:02.562605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff91ac-03c4-482c-8d7f-26145725991b admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:02.571039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff91ac-03c4-482c-8d7f-26145725991b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:29:02.571039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff91ac-03c4-482c-8d7f-26145725991b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:02.571039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff91ac-03c4-482c-8d7f-26145725991b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:02.581251 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1133/2263] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:29:02.586088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff91ac-03c4-482c-8d7f-26145725991b admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:02.602297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff91ac-03c4-482c-8d7f-26145725991b admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:02.611025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5f393-718e-40e7-8ffd-ce1b2266c0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:02.611814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5f393-718e-40e7-8ffd-ce1b2266c0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:02.612094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5f393-718e-40e7-8ffd-ce1b2266c0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:02.612371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5f393-718e-40e7-8ffd-ce1b2266c0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:02.613099 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5f393-718e-40e7-8ffd-ce1b2266c0f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:02.619014 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5f393-718e-40e7-8ffd-ce1b2266c0f8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:02.636658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1131/2264] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:29:02 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:29:02.647560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9461db-a08c-4a87-a474-874750fecdb4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:02.736769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1134/2265] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:29:02 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:29:02.742160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5f393-718e-40e7-8ffd-ce1b2266c0f8 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:02.751783 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9461db-a08c-4a87-a474-874750fecdb4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:02.905942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5f393-718e-40e7-8ffd-ce1b2266c0f8 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:02.910158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd89418-ad7e-41c7-aba8-cdef50c7a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:02.910848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd89418-ad7e-41c7-aba8-cdef50c7a1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:02.911145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd89418-ad7e-41c7-aba8-cdef50c7a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:02.911465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11f9a8-eb7d-4b09-925f-ae6baffb66a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:02.912158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11f9a8-eb7d-4b09-925f-ae6baffb66a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:02.912447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11f9a8-eb7d-4b09-925f-ae6baffb66a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:02.912730 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11f9a8-eb7d-4b09-925f-ae6baffb66a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:02.914581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11f9a8-eb7d-4b09-925f-ae6baffb66a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:02.916628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11f9a8-eb7d-4b09-925f-ae6baffb66a1 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:02.917358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd89418-ad7e-41c7-aba8-cdef50c7a1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:02.918100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd89418-ad7e-41c7-aba8-cdef50c7a1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:02.924484 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd89418-ad7e-41c7-aba8-cdef50c7a1c5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:03.066377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1135/2266] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:29:02 2022] POST /identity/v3/users => generated 289 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:29:03.072457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11f9a8-eb7d-4b09-925f-ae6baffb66a1 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:03.079747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1132/2267] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:29:02 2022] POST /identity/v3/users => generated 293 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:29:03.085523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd89418-ad7e-41c7-aba8-cdef50c7a1c5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:03.093482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11f9a8-eb7d-4b09-925f-ae6baffb66a1 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:03.100039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6328970-2d42-4009-ae16-8027650e2437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:03.100904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6328970-2d42-4009-ae16-8027650e2437 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:03.101374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6328970-2d42-4009-ae16-8027650e2437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:03.101821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6328970-2d42-4009-ae16-8027650e2437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:03.102861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6328970-2d42-4009-ae16-8027650e2437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:03.104719 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6328970-2d42-4009-ae16-8027650e2437 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:03.107439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd89418-ad7e-41c7-aba8-cdef50c7a1c5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:03.113058 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace07c4-e8a3-4d51-92be-32e5340ca7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:03.113804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace07c4-e8a3-4d51-92be-32e5340ca7cb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:03.114073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace07c4-e8a3-4d51-92be-32e5340ca7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:03.114406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace07c4-e8a3-4d51-92be-32e5340ca7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:03.115310 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace07c4-e8a3-4d51-92be-32e5340ca7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:03.117487 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace07c4-e8a3-4d51-92be-32e5340ca7cb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:03.118294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1136/2268] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:29:03.121964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6328970-2d42-4009-ae16-8027650e2437 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:03.133923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6328970-2d42-4009-ae16-8027650e2437 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:03.138954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f2600-cad5-4edf-9772-ab8f8cb2de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:03.140160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f2600-cad5-4edf-9772-ab8f8cb2de76 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:03.140160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f2600-cad5-4edf-9772-ab8f8cb2de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:03.140365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f2600-cad5-4edf-9772-ab8f8cb2de76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:03.140967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f2600-cad5-4edf-9772-ab8f8cb2de76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:03.141552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1133/2269] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:29:03.142679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f2600-cad5-4edf-9772-ab8f8cb2de76 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:03.145583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace07c4-e8a3-4d51-92be-32e5340ca7cb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:03.157846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1137/2270] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:29:03.158064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace07c4-e8a3-4d51-92be-32e5340ca7cb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:03.161780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f2600-cad5-4edf-9772-ab8f8cb2de76 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:03.166406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b4534-8726-4250-af4f-b141a023a13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:03.167351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4534-8726-4250-af4f-b141a023a13f admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:03.168358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4534-8726-4250-af4f-b141a023a13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:03.169767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4534-8726-4250-af4f-b141a023a13f admin admin] PATH_INFO: `/v3/projects/efcb3207c1374d1391e39167ac8785cf/users/726055e86775484ca6dfedc355f79af0/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:03.173666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f2600-cad5-4edf-9772-ab8f8cb2de76 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:03.179678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21130f-a605-4e1f-a246-801560723ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:03.180975 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21130f-a605-4e1f-a246-801560723ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:03.181572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21130f-a605-4e1f-a246-801560723ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:03.182211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21130f-a605-4e1f-a246-801560723ef9 admin admin] PATH_INFO: `/v3/projects/e3a6cdd8f82749518274be1a11635bb8/users/a03f3f159f9a457d91fb82b6c7308b4f/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:03.191601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b4534-8726-4250-af4f-b141a023a13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcb3207c1374d1391e39167ac8785cf, user_id=726055e86775484ca6dfedc355f79af0, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:03.195046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b4534-8726-4250-af4f-b141a023a13f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:03.206484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21130f-a605-4e1f-a246-801560723ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a6cdd8f82749518274be1a11635bb8, user_id=a03f3f159f9a457d91fb82b6c7308b4f, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:03.209398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21130f-a605-4e1f-a246-801560723ef9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:03.292683 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1134/2271] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:29:03 2022] PUT /identity/v3/projects/efcb3207c1374d1391e39167ac8785cf/users/726055e86775484ca6dfedc355f79af0/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:29:03.294039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b4534-8726-4250-af4f-b141a023a13f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:03.310828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1138/2272] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:29:03 2022] PUT /identity/v3/projects/e3a6cdd8f82749518274be1a11635bb8/users/a03f3f159f9a457d91fb82b6c7308b4f/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:29:03.321588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570757d2-98d1-4422-9713-169e20f2d77b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:03.322021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570757d2-98d1-4422-9713-169e20f2d77b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:03.322405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570757d2-98d1-4422-9713-169e20f2d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:03.370579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b4534-8726-4250-af4f-b141a023a13f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:03.381065 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-570757d2-98d1-4422-9713-169e20f2d77b None None] MFA Rules not processed for user `a03f3f159f9a457d91fb82b6c7308b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:03.385656 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-570757d2-98d1-4422-9713-169e20f2d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:03.493580 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be76a2-09ec-44af-b04d-c168ba7c8874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:03.494264 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be76a2-09ec-44af-b04d-c168ba7c8874 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:03.494554 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be76a2-09ec-44af-b04d-c168ba7c8874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:03.494832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be76a2-09ec-44af-b04d-c168ba7c8874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:03.512229 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be76a2-09ec-44af-b04d-c168ba7c8874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:03.514403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be76a2-09ec-44af-b04d-c168ba7c8874 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:03.531699 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1135/2273] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:29:03.532923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be76a2-09ec-44af-b04d-c168ba7c8874 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:03.550570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1139/2274] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:29:03.556514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be76a2-09ec-44af-b04d-c168ba7c8874 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:03.562155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570757d2-98d1-4422-9713-169e20f2d77b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:03.562572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd1988-1155-4e7a-8b68-d9f7a558804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:03.563688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1988-1155-4e7a-8b68-d9f7a558804c admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:03.564139 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1988-1155-4e7a-8b68-d9f7a558804c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:03.564268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-570757d2-98d1-4422-9713-169e20f2d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:03.564693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd1988-1155-4e7a-8b68-d9f7a558804c admin admin] PATH_INFO: `/v3/projects/efcb3207c1374d1391e39167ac8785cf/users/726055e86775484ca6dfedc355f79af0/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:03.567441 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd1988-1155-4e7a-8b68-d9f7a558804c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcb3207c1374d1391e39167ac8785cf, user_id=726055e86775484ca6dfedc355f79af0, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:03.570478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd1988-1155-4e7a-8b68-d9f7a558804c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:03.586666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1136/2275] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:29:03 2022] PUT /identity/v3/projects/efcb3207c1374d1391e39167ac8785cf/users/726055e86775484ca6dfedc355f79af0/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:29:03.653159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570757d2-98d1-4422-9713-169e20f2d77b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:03.725615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9829-8821-415b-b7a1-d057dcc80ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:03.726283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9829-8821-415b-b7a1-d057dcc80ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:03.726921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9829-8821-415b-b7a1-d057dcc80ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:03.729245 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9829-8821-415b-b7a1-d057dcc80ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:03.797480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f9829-8821-415b-b7a1-d057dcc80ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:03.810555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f9829-8821-415b-b7a1-d057dcc80ed7 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:03.840891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1140/2276] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:29:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:29:11.701510 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93aba-cb0e-4cdb-bd26-0f074c6de498 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:11.702041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93aba-cb0e-4cdb-bd26-0f074c6de498 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:11.702130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93aba-cb0e-4cdb-bd26-0f074c6de498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:11.732243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-81f93aba-cb0e-4cdb-bd26-0f074c6de498 None None] MFA Rules not processed for user `726055e86775484ca6dfedc355f79af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:11.733710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-81f93aba-cb0e-4cdb-bd26-0f074c6de498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:11.807680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1137/2277] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:11.823614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9829-8821-415b-b7a1-d057dcc80ed7 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:11.828066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-417f9829-8821-415b-b7a1-d057dcc80ed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:11.951441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9829-8821-415b-b7a1-d057dcc80ed7 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:11.958283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0e184-e946-44f5-9c35-84128996924d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:11.959726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e184-e946-44f5-9c35-84128996924d service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:11.964151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e184-e946-44f5-9c35-84128996924d service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:11.964151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e184-e946-44f5-9c35-84128996924d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:12.030821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0e184-e946-44f5-9c35-84128996924d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:12.032487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0e184-e946-44f5-9c35-84128996924d service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:12.042061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1141/2278] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:29:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:29:12.961311 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fa7fd-162a-4bc3-8e12-486a0868323a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:12.961820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fa7fd-162a-4bc3-8e12-486a0868323a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:12.961930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fa7fd-162a-4bc3-8e12-486a0868323a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:12.988157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-971fa7fd-162a-4bc3-8e12-486a0868323a None None] MFA Rules not processed for user `bf8f7f47fe6c4a88b415ec21b36fcdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:12.988157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-971fa7fd-162a-4bc3-8e12-486a0868323a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:13.057616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1138/2279] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:15.067708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24bdf-8221-44fb-971b-77c3b262dd04 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:15.068350 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24bdf-8221-44fb-971b-77c3b262dd04 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:15.068350 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24bdf-8221-44fb-971b-77c3b262dd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:15.087789 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-ecd24bdf-8221-44fb-971b-77c3b262dd04 None None] MFA Rules not processed for user `72919bd9efe84fa8acf2b407d7b6b13d`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:15.089517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ecd24bdf-8221-44fb-971b-77c3b262dd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:15.098413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1142/2280] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:29:20.012637 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72ac0-2fc1-445d-a4d4-53be528fa86a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:20.013134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72ac0-2fc1-445d-a4d4-53be528fa86a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:20.013247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72ac0-2fc1-445d-a4d4-53be528fa86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:20.033552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e1d72ac0-2fc1-445d-a4d4-53be528fa86a None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:20.034831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e1d72ac0-2fc1-445d-a4d4-53be528fa86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:20.109414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1139/2281] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:29:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:29:20.127568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd24bdf-8221-44fb-971b-77c3b262dd04 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:20.132637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ecd24bdf-8221-44fb-971b-77c3b262dd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:20.210746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd24bdf-8221-44fb-971b-77c3b262dd04 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:20.217101 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a2241-e106-44b4-93f0-61eee5e612dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:20.217763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a2241-e106-44b4-93f0-61eee5e612dc service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:20.218047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a2241-e106-44b4-93f0-61eee5e612dc service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:20.218327 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a2241-e106-44b4-93f0-61eee5e612dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:20.228974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a2241-e106-44b4-93f0-61eee5e612dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:20.230699 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a2241-e106-44b4-93f0-61eee5e612dc service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:20.240353 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1143/2282] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:29:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 17:29:42.923495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c72e9-0b3a-4196-8165-97d95cdbd330 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:42.924075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c72e9-0b3a-4196-8165-97d95cdbd330 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:42.924075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c72e9-0b3a-4196-8165-97d95cdbd330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:42.941732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4a3c72e9-0b3a-4196-8165-97d95cdbd330 None None] MFA Rules not processed for user `e7d764501bed41d99941c6e083e19482`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:42.942985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4a3c72e9-0b3a-4196-8165-97d95cdbd330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:42.996820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1140/2283] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:45.353403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a2241-e106-44b4-93f0-61eee5e612dc service swift] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:45.412484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a2241-e106-44b4-93f0-61eee5e612dc service swift] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:45.416955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:45.417815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:45.418101 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:45.418377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] PATH_INFO: `/v3/users/a03f3f159f9a457d91fb82b6c7308b4f` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:45.419608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03f3f159f9a457d91fb82b6c7308b4f)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:45.421539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:45.609711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03f3f159f9a457d91fb82b6c7308b4f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:45.621547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03f3f159f9a457d91fb82b6c7308b4f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:45.622207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03f3f159f9a457d91fb82b6c7308b4f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:45.692816 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03f3f159f9a457d91fb82b6c7308b4f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:45.699636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03f3f159f9a457d91fb82b6c7308b4f'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:45.705454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1144/2284] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:29:45 2022] DELETE /identity/v3/users/a03f3f159f9a457d91fb82b6c7308b4f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:29:45.710100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c540bb-2015-4cce-99e6-ae848c62eb32 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:45.713615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c540bb-2015-4cce-99e6-ae848c62eb32 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:45.713615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c540bb-2015-4cce-99e6-ae848c62eb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:45.728562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c2c540bb-2015-4cce-99e6-ae848c62eb32 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:45.729806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c2c540bb-2015-4cce-99e6-ae848c62eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:45.788888 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1141/2285] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:45.798265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:45.799720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:45.857208 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23d9b-0eb4-4c52-9d9b-fa1c7fad7c63 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:45.860910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb975194-2796-406c-b88c-18ca7874dcd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:45.861565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb975194-2796-406c-b88c-18ca7874dcd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:45.861852 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb975194-2796-406c-b88c-18ca7874dcd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:45.862134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb975194-2796-406c-b88c-18ca7874dcd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:45.871909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb975194-2796-406c-b88c-18ca7874dcd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:45.873392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb975194-2796-406c-b88c-18ca7874dcd8 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:45.883114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1145/2286] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:29:46.276777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c540bb-2015-4cce-99e6-ae848c62eb32 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:46.278196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c2c540bb-2015-4cce-99e6-ae848c62eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:46.291872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c540bb-2015-4cce-99e6-ae848c62eb32 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:46.304048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:46.304931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:46.305215 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:46.305522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] PATH_INFO: `/v3/projects/e3a6cdd8f82749518274be1a11635bb8` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:46.307307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a6cdd8f82749518274be1a11635bb8)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:46.309292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:46.429458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a6cdd8f82749518274be1a11635bb8', 'request_id': 'req-35d82706-caa6-400c-ab3c-3dcf38af1dcc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:46.434745 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a6cdd8f82749518274be1a11635bb8', 'request_id': 'req-35d82706-caa6-400c-ab3c-3dcf38af1dcc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:46.498144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a6cdd8f82749518274be1a11635bb8', 'request_id': 'req-35d82706-caa6-400c-ab3c-3dcf38af1dcc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:46.509501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] The token cache is being invalidate because project e3a6cdd8f82749518274be1a11635bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:29:46.509784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:46.510447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-35d82706-caa6-400c-ab3c-3dcf38af1dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:46.512012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1142/2287] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:29:46 2022] DELETE /identity/v3/projects/e3a6cdd8f82749518274be1a11635bb8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:29:46.517237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8512f2-248a-4c12-9e0b-d7dddc34f860 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:46.518081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8512f2-248a-4c12-9e0b-d7dddc34f860 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:46.518370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8512f2-248a-4c12-9e0b-d7dddc34f860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:46.537340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-ee8512f2-248a-4c12-9e0b-d7dddc34f860 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:46.538810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ee8512f2-248a-4c12-9e0b-d7dddc34f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:46.603422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1146/2288] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:46.611814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b376649-92d5-4aa1-b447-8391fecc181c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:46.612110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b376649-92d5-4aa1-b447-8391fecc181c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:46.612391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b376649-92d5-4aa1-b447-8391fecc181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:46.630720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8b376649-92d5-4aa1-b447-8391fecc181c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:46.631954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8b376649-92d5-4aa1-b447-8391fecc181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:46.640085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1143/2289] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:46.644568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8512f2-248a-4c12-9e0b-d7dddc34f860 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:46.653989 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8512f2-248a-4c12-9e0b-d7dddc34f860 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:46.658530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decbfe4-bf26-4453-80b8-2ed64aec4a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:46.659214 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decbfe4-bf26-4453-80b8-2ed64aec4a67 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:46.659501 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decbfe4-bf26-4453-80b8-2ed64aec4a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:46.660347 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decbfe4-bf26-4453-80b8-2ed64aec4a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:46.661069 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decbfe4-bf26-4453-80b8-2ed64aec4a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:29:46.661377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decbfe4-bf26-4453-80b8-2ed64aec4a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:46.662977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decbfe4-bf26-4453-80b8-2ed64aec4a67 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:46.674051 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1147/2290] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:29:46.678076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b376649-92d5-4aa1-b447-8391fecc181c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:46.686957 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b376649-92d5-4aa1-b447-8391fecc181c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:46.691679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dc80a-9ec3-418b-bda0-7aa5eef09dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:46.692306 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc80a-9ec3-418b-bda0-7aa5eef09dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:46.692584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc80a-9ec3-418b-bda0-7aa5eef09dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:46.692855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc80a-9ec3-418b-bda0-7aa5eef09dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:46.693530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dc80a-9ec3-418b-bda0-7aa5eef09dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:46.695468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dc80a-9ec3-418b-bda0-7aa5eef09dc6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:46.802447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1144/2291] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:29:46 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:29:46.806646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decbfe4-bf26-4453-80b8-2ed64aec4a67 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:46.816909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decbfe4-bf26-4453-80b8-2ed64aec4a67 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:46.870457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7c2c4-e4cd-4550-80c7-c4e5b16366eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:46.871148 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7c2c4-e4cd-4550-80c7-c4e5b16366eb admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:46.871432 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7c2c4-e4cd-4550-80c7-c4e5b16366eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:46.871708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7c2c4-e4cd-4550-80c7-c4e5b16366eb admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:46.872402 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7c2c4-e4cd-4550-80c7-c4e5b16366eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:46.874386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7c2c4-e4cd-4550-80c7-c4e5b16366eb admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:46.957610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1148/2292] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:29:46 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:29:46.961533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dc80a-9ec3-418b-bda0-7aa5eef09dc6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:46.972301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dc80a-9ec3-418b-bda0-7aa5eef09dc6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:46.976902 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82213f3-c994-4ec1-a378-8ad7877aef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:46.977551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82213f3-c994-4ec1-a378-8ad7877aef43 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:46.977833 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82213f3-c994-4ec1-a378-8ad7877aef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:46.978179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82213f3-c994-4ec1-a378-8ad7877aef43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:46.978901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82213f3-c994-4ec1-a378-8ad7877aef43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:46.980544 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82213f3-c994-4ec1-a378-8ad7877aef43 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:46.991070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1145/2293] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:29:46.995121 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7c2c4-e4cd-4550-80c7-c4e5b16366eb admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:47.006240 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7c2c4-e4cd-4550-80c7-c4e5b16366eb admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:47.010850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf4e3f-8fdf-41b0-a6db-fce4051d9093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:47.011543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf4e3f-8fdf-41b0-a6db-fce4051d9093 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:47.011825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf4e3f-8fdf-41b0-a6db-fce4051d9093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:47.012108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf4e3f-8fdf-41b0-a6db-fce4051d9093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:47.012953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf4e3f-8fdf-41b0-a6db-fce4051d9093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:47.014570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf4e3f-8fdf-41b0-a6db-fce4051d9093 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:47.025316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1149/2294] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:29:47.031616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82213f3-c994-4ec1-a378-8ad7877aef43 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:47.041630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82213f3-c994-4ec1-a378-8ad7877aef43 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:47.046215 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f585-c982-4bfd-9dee-42372ea56042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:47.047083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f585-c982-4bfd-9dee-42372ea56042 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:47.047401 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f585-c982-4bfd-9dee-42372ea56042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:47.047679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f585-c982-4bfd-9dee-42372ea56042 admin admin] PATH_INFO: `/v3/projects/853e00cf61544b56b1ec0e161b8409ff/users/c84bcfa065004e4889bf54ed38469151/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:47.061608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f585-c982-4bfd-9dee-42372ea56042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853e00cf61544b56b1ec0e161b8409ff, user_id=c84bcfa065004e4889bf54ed38469151, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:47.064338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f585-c982-4bfd-9dee-42372ea56042 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:47.160355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1146/2295] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:29:47 2022] PUT /identity/v3/projects/853e00cf61544b56b1ec0e161b8409ff/users/c84bcfa065004e4889bf54ed38469151/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:29:47.170949 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf22cf-2381-4bc6-80f7-d822344823dc None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:47.171282 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf22cf-2381-4bc6-80f7-d822344823dc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:47.171566 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf22cf-2381-4bc6-80f7-d822344823dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:47.198110 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-8fdf22cf-2381-4bc6-80f7-d822344823dc None None] MFA Rules not processed for user `c84bcfa065004e4889bf54ed38469151`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:47.199354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8fdf22cf-2381-4bc6-80f7-d822344823dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:47.260976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1150/2296] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:47.272029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f585-c982-4bfd-9dee-42372ea56042 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:47.273747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d003f585-c982-4bfd-9dee-42372ea56042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:47.350080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f585-c982-4bfd-9dee-42372ea56042 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:47.354612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b18d9c-753a-401a-9650-31a11c625000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:47.355296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18d9c-753a-401a-9650-31a11c625000 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:47.355582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18d9c-753a-401a-9650-31a11c625000 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:47.355859 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18d9c-753a-401a-9650-31a11c625000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:47.365454 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b18d9c-753a-401a-9650-31a11c625000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:47.366946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b18d9c-753a-401a-9650-31a11c625000 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:47.377240 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1147/2297] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:29:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:29:47.403435 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf22cf-2381-4bc6-80f7-d822344823dc None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:47.470605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf22cf-2381-4bc6-80f7-d822344823dc None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:47.476405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e8591-9e30-441c-99cb-6824aecd5789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:47.477384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e8591-9e30-441c-99cb-6824aecd5789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:47.477733 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e8591-9e30-441c-99cb-6824aecd5789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:47.478082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e8591-9e30-441c-99cb-6824aecd5789 admin admin] PATH_INFO: `/v3/users/c84bcfa065004e4889bf54ed38469151` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:47.479405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e8591-9e30-441c-99cb-6824aecd5789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84bcfa065004e4889bf54ed38469151)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:47.489092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e8591-9e30-441c-99cb-6824aecd5789 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:47.680351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-e49e8591-9e30-441c-99cb-6824aecd5789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84bcfa065004e4889bf54ed38469151'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:47.692569 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-e49e8591-9e30-441c-99cb-6824aecd5789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84bcfa065004e4889bf54ed38469151'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:47.693224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-e49e8591-9e30-441c-99cb-6824aecd5789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84bcfa065004e4889bf54ed38469151'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:47.754800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b18d9c-753a-401a-9650-31a11c625000 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:47.756273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-51b18d9c-753a-401a-9650-31a11c625000 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:47.762417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-e49e8591-9e30-441c-99cb-6824aecd5789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84bcfa065004e4889bf54ed38469151'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:47.771261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-e49e8591-9e30-441c-99cb-6824aecd5789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84bcfa065004e4889bf54ed38469151'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:47.779052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1151/2298] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:29:47 2022] DELETE /identity/v3/users/c84bcfa065004e4889bf54ed38469151 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:29:47.783919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1d4c-98c9-4a11-af40-e10d41649b24 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:47.784228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1d4c-98c9-4a11-af40-e10d41649b24 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:47.784508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1d4c-98c9-4a11-af40-e10d41649b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:47.805507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e6ad1d4c-98c9-4a11-af40-e10d41649b24 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:47.806728 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e6ad1d4c-98c9-4a11-af40-e10d41649b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:47.852198 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b18d9c-753a-401a-9650-31a11c625000 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:47.877779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1152/2299] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:47.887360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1d4c-98c9-4a11-af40-e10d41649b24 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:47.889095 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e6ad1d4c-98c9-4a11-af40-e10d41649b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:47.919589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5377aec-4f67-42c9-b895-b964fb385f00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84ae21424694df68a96b928e15e9240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:47.920424 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377aec-4f67-42c9-b895-b964fb385f00 service placement] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:47.920707 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377aec-4f67-42c9-b895-b964fb385f00 service placement] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:47.921105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377aec-4f67-42c9-b895-b964fb385f00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:47.923050 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b5377aec-4f67-42c9-b895-b964fb385f00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:47.935324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5377aec-4f67-42c9-b895-b964fb385f00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:47.936959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5377aec-4f67-42c9-b895-b964fb385f00 service placement] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:47.947719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1148/2300] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:29:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:29:47.949679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1d4c-98c9-4a11-af40-e10d41649b24 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:47.953441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626bad7-dfcf-4375-8b53-1e7c176e96bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:47.955175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626bad7-dfcf-4375-8b53-1e7c176e96bc service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:47.955175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626bad7-dfcf-4375-8b53-1e7c176e96bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:47.955175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626bad7-dfcf-4375-8b53-1e7c176e96bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:47.967674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626bad7-dfcf-4375-8b53-1e7c176e96bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:47.969253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626bad7-dfcf-4375-8b53-1e7c176e96bc service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:47.979344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1153/2301] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:29:48.419384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5377aec-4f67-42c9-b895-b964fb385f00 service placement] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:48.420940 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b5377aec-4f67-42c9-b895-b964fb385f00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:48.435418 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5377aec-4f67-42c9-b895-b964fb385f00 service placement] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:48.440291 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:48.441148 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:48.441430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:48.441726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] PATH_INFO: `/v3/projects/853e00cf61544b56b1ec0e161b8409ff` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:48.442938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853e00cf61544b56b1ec0e161b8409ff)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:48.444923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:48.556233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853e00cf61544b56b1ec0e161b8409ff', 'request_id': 'req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:48.561922 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853e00cf61544b56b1ec0e161b8409ff', 'request_id': 'req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:48.625039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853e00cf61544b56b1ec0e161b8409ff', 'request_id': 'req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:48.638943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] The token cache is being invalidate because project 853e00cf61544b56b1ec0e161b8409ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:29:48.639610 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:48.640629 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7c13e88b-6795-49e9-9b93-3ff1c0f9ce42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:29:48.642411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1149/2302] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:29:48 2022] DELETE /identity/v3/projects/853e00cf61544b56b1ec0e161b8409ff => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:29:48.648278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2199a-1878-4ea9-9f23-a1a4b9d9bae5 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:48.648568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2199a-1878-4ea9-9f23-a1a4b9d9bae5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:48.651731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2199a-1878-4ea9-9f23-a1a4b9d9bae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:48.677872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-13f2199a-1878-4ea9-9f23-a1a4b9d9bae5 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:48.677872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-13f2199a-1878-4ea9-9f23-a1a4b9d9bae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:48.746607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1154/2303] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:48.754634 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0c93e-098a-4114-9b4f-cb9cbdf3031d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:48.754983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0c93e-098a-4114-9b4f-cb9cbdf3031d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:48.755301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0c93e-098a-4114-9b4f-cb9cbdf3031d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:48.773753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8ae0c93e-098a-4114-9b4f-cb9cbdf3031d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:48.777114 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8ae0c93e-098a-4114-9b4f-cb9cbdf3031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:48.783043 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1150/2304] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:48.787989 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2199a-1878-4ea9-9f23-a1a4b9d9bae5 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:48.797496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2199a-1878-4ea9-9f23-a1a4b9d9bae5 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:48.803091 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994e1d2-aa2c-4fb2-bde2-8c255c19d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:48.803844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994e1d2-aa2c-4fb2-bde2-8c255c19d559 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:48.804134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994e1d2-aa2c-4fb2-bde2-8c255c19d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:48.804419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994e1d2-aa2c-4fb2-bde2-8c255c19d559 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:48.805157 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994e1d2-aa2c-4fb2-bde2-8c255c19d559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:29:48.805510 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994e1d2-aa2c-4fb2-bde2-8c255c19d559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:48.807260 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994e1d2-aa2c-4fb2-bde2-8c255c19d559 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:48.819023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1155/2305] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:29:48.823442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0c93e-098a-4114-9b4f-cb9cbdf3031d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:48.833364 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0c93e-098a-4114-9b4f-cb9cbdf3031d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:48.838105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65401f-c645-4bdf-9543-d711226b7f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:48.838777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65401f-c645-4bdf-9543-d711226b7f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:48.839090 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65401f-c645-4bdf-9543-d711226b7f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:48.839409 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65401f-c645-4bdf-9543-d711226b7f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:48.840085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65401f-c645-4bdf-9543-d711226b7f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:48.844915 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65401f-c645-4bdf-9543-d711226b7f01 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:48.928039 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1151/2306] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:29:48 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:29:48.932059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994e1d2-aa2c-4fb2-bde2-8c255c19d559 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:48.941861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994e1d2-aa2c-4fb2-bde2-8c255c19d559 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:48.996289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e7ed7-c456-4211-9822-7fbaa103fdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:48.996976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e7ed7-c456-4211-9822-7fbaa103fdcb admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:48.997267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e7ed7-c456-4211-9822-7fbaa103fdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:48.997550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e7ed7-c456-4211-9822-7fbaa103fdcb admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:48.998266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e7ed7-c456-4211-9822-7fbaa103fdcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:49.000264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e7ed7-c456-4211-9822-7fbaa103fdcb admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:49.093500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1156/2307] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:29:48 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:29:49.097748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65401f-c645-4bdf-9543-d711226b7f01 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:49.107999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65401f-c645-4bdf-9543-d711226b7f01 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:49.113174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6a42-fb48-44b7-b73f-e3c4039a07be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:49.113880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6a42-fb48-44b7-b73f-e3c4039a07be admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:49.114164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6a42-fb48-44b7-b73f-e3c4039a07be admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:49.114501 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6a42-fb48-44b7-b73f-e3c4039a07be admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:49.115265 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba6a42-fb48-44b7-b73f-e3c4039a07be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:49.116943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba6a42-fb48-44b7-b73f-e3c4039a07be admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:49.128084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1152/2308] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:29:49.132569 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e7ed7-c456-4211-9822-7fbaa103fdcb admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:49.142634 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e7ed7-c456-4211-9822-7fbaa103fdcb admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:49.147922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d3bc-2c74-4132-8d00-70957f83f3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:49.148575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d3bc-2c74-4132-8d00-70957f83f3cb admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:49.148868 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d3bc-2c74-4132-8d00-70957f83f3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:49.149145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d3bc-2c74-4132-8d00-70957f83f3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:49.149868 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424d3bc-2c74-4132-8d00-70957f83f3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:49.151562 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424d3bc-2c74-4132-8d00-70957f83f3cb admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:49.161581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1157/2309] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:29:49.165722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6a42-fb48-44b7-b73f-e3c4039a07be admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:49.175609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6a42-fb48-44b7-b73f-e3c4039a07be admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:49.180111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954df75-dec8-4e84-8857-18d0398372ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:49.180993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954df75-dec8-4e84-8857-18d0398372ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:49.181268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954df75-dec8-4e84-8857-18d0398372ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:49.181538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954df75-dec8-4e84-8857-18d0398372ab admin admin] PATH_INFO: `/v3/projects/e9f5f08db8cb40f0857115f4c9aadaf7/users/00983ee7706f43d4b3f7d0f178c0e924/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:49.195855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954df75-dec8-4e84-8857-18d0398372ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f5f08db8cb40f0857115f4c9aadaf7, user_id=00983ee7706f43d4b3f7d0f178c0e924, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:49.198518 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954df75-dec8-4e84-8857-18d0398372ab admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:49.264524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1153/2310] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:29:49 2022] PUT /identity/v3/projects/e9f5f08db8cb40f0857115f4c9aadaf7/users/00983ee7706f43d4b3f7d0f178c0e924/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:29:49.270004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc2563-a187-4e62-99e1-01126e18f664 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:49.270294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc2563-a187-4e62-99e1-01126e18f664 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:49.270572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc2563-a187-4e62-99e1-01126e18f664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:49.288206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-4abc2563-a187-4e62-99e1-01126e18f664 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:49.289457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-4abc2563-a187-4e62-99e1-01126e18f664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:49.348093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1158/2311] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:49.357571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954df75-dec8-4e84-8857-18d0398372ab admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:49.359301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d954df75-dec8-4e84-8857-18d0398372ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:49.415390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954df75-dec8-4e84-8857-18d0398372ab admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:49.419038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba84da-756c-457e-9cf4-f7f8325e80cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:49.419721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba84da-756c-457e-9cf4-f7f8325e80cb service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:49.420006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba84da-756c-457e-9cf4-f7f8325e80cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:49.420286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba84da-756c-457e-9cf4-f7f8325e80cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:49.429776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba84da-756c-457e-9cf4-f7f8325e80cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:49.431293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba84da-756c-457e-9cf4-f7f8325e80cb service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:49.440575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1154/2312] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:29:50.691056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c70d6-59e7-414b-a8a5-004ca9e799f9 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:50.691588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c70d6-59e7-414b-a8a5-004ca9e799f9 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:50.691681 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c70d6-59e7-414b-a8a5-004ca9e799f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:50.720141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-167c70d6-59e7-414b-a8a5-004ca9e799f9 None None] MFA Rules not processed for user `00983ee7706f43d4b3f7d0f178c0e924`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:50.721619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-167c70d6-59e7-414b-a8a5-004ca9e799f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:50.841168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1159/2313] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:50.872701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba84da-756c-457e-9cf4-f7f8325e80cb service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:29:50.874570 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-cdba84da-756c-457e-9cf4-f7f8325e80cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:50.999098 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba84da-756c-457e-9cf4-f7f8325e80cb service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:29:51.003221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6c8e-98d2-462e-8ff6-324e5ec3b2d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:29:51.004894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6c8e-98d2-462e-8ff6-324e5ec3b2d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:51.005411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6c8e-98d2-462e-8ff6-324e5ec3b2d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:51.005951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6c8e-98d2-462e-8ff6-324e5ec3b2d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:51.018873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6c8e-98d2-462e-8ff6-324e5ec3b2d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:29:51.020636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6c8e-98d2-462e-8ff6-324e5ec3b2d3 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:29:51.030536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1155/2314] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:29:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:29:53.883015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7b21-d001-46a8-b1cc-2816e762f0eb None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:53.887209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7b21-d001-46a8-b1cc-2816e762f0eb None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:53.887209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7b21-d001-46a8-b1cc-2816e762f0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:53.901708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-eb8b7b21-d001-46a8-b1cc-2816e762f0eb None None] MFA Rules not processed for user `00983ee7706f43d4b3f7d0f178c0e924`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:53.902944 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-eb8b7b21-d001-46a8-b1cc-2816e762f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:53.911294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1160/2315] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:29:59.703253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f375-fb8b-4366-85fe-6d76adc6da6c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:29:59.703956 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f375-fb8b-4366-85fe-6d76adc6da6c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:29:59.704119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f375-fb8b-4366-85fe-6d76adc6da6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:29:59.721214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-55c1f375-fb8b-4366-85fe-6d76adc6da6c None None] MFA Rules not processed for user `dfc52b61bcf845d1953a5a111abb3666`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:29:59.722937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-55c1f375-fb8b-4366-85fe-6d76adc6da6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:29:59.781527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1156/2316] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:29:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:30:16.020790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b7b21-d001-46a8-b1cc-2816e762f0eb None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:30:16.022254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-eb8b7b21-d001-46a8-b1cc-2816e762f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:30:16.034422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b7b21-d001-46a8-b1cc-2816e762f0eb None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:30:16.038936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac895b5-6cfd-41d3-8fdd-a32ef6928ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:30:16.039707 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac895b5-6cfd-41d3-8fdd-a32ef6928ebf service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:30:16.039998 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac895b5-6cfd-41d3-8fdd-a32ef6928ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:30:16.040278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac895b5-6cfd-41d3-8fdd-a32ef6928ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:30:16.042146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7ac895b5-6cfd-41d3-8fdd-a32ef6928ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:30:16.111753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac895b5-6cfd-41d3-8fdd-a32ef6928ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:30:16.113869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac895b5-6cfd-41d3-8fdd-a32ef6928ebf service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:30:16.125173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1161/2317] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:30:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:30:42.565993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a377a-dc98-47e0-a3f5-4d1168460277 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:30:42.567794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a377a-dc98-47e0-a3f5-4d1168460277 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:30:42.567794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a377a-dc98-47e0-a3f5-4d1168460277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:30:42.626135 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-469a377a-dc98-47e0-a3f5-4d1168460277 None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:30:42.628141 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-469a377a-dc98-47e0-a3f5-4d1168460277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:30:42.700866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1157/2318] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:30:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:30:42.749507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac895b5-6cfd-41d3-8fdd-a32ef6928ebf service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:30:42.749973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7ac895b5-6cfd-41d3-8fdd-a32ef6928ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:30:42.851864 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac895b5-6cfd-41d3-8fdd-a32ef6928ebf service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:30:42.858558 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11b19c-f385-4e8a-8035-0fc2adf98983 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:30:42.859424 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11b19c-f385-4e8a-8035-0fc2adf98983 service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:30:42.859583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11b19c-f385-4e8a-8035-0fc2adf98983 service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:30:42.859860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11b19c-f385-4e8a-8035-0fc2adf98983 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:30:42.868337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11b19c-f385-4e8a-8035-0fc2adf98983 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:30:42.870024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11b19c-f385-4e8a-8035-0fc2adf98983 service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:30:42.878262 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1162/2319] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:30:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:30:56.174471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7abb21-34b8-4229-83a5-f0f7bffcf4d0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:30:56.175167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7abb21-34b8-4229-83a5-f0f7bffcf4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:30:56.175167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7abb21-34b8-4229-83a5-f0f7bffcf4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:30:56.201028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-fa7abb21-34b8-4229-83a5-f0f7bffcf4d0 None None] MFA Rules not processed for user `a0294c57ba3f41bc8cf2cac294bb678c`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:30:56.202512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fa7abb21-34b8-4229-83a5-f0f7bffcf4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:30:56.272363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1158/2320] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:30:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:30:58.060477 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11b19c-f385-4e8a-8035-0fc2adf98983 service swift] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:30:58.072542 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11b19c-f385-4e8a-8035-0fc2adf98983 service swift] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:30:58.077073 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9213e7-51d0-4426-93f8-9ae73c626a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:30:58.078063 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9213e7-51d0-4426-93f8-9ae73c626a7f service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:30:58.078400 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9213e7-51d0-4426-93f8-9ae73c626a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:30:58.080118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9213e7-51d0-4426-93f8-9ae73c626a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:30:58.080905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8a9213e7-51d0-4426-93f8-9ae73c626a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:30:58.175531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9213e7-51d0-4426-93f8-9ae73c626a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:30:58.177403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9213e7-51d0-4426-93f8-9ae73c626a7f service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:30:58.191685 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1163/2321] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:30:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:31:02.748097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd99c2-2b53-42e4-a44d-e4a91229ecff None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:02.748527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd99c2-2b53-42e4-a44d-e4a91229ecff None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:02.748722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd99c2-2b53-42e4-a44d-e4a91229ecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:02.776337 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-abfd99c2-2b53-42e4-a44d-e4a91229ecff None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:31:02.777874 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-abfd99c2-2b53-42e4-a44d-e4a91229ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:02.788055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1159/2322] 10.222.0.64 () {58 vars in 967 bytes} [Fri May 13 17:31:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:31:02.801556 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9213e7-51d0-4426-93f8-9ae73c626a7f service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:02.813136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9213e7-51d0-4426-93f8-9ae73c626a7f service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:02.819372 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c6529-8e05-440e-8bdd-70b28b6c7bb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:02.821887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c6529-8e05-440e-8bdd-70b28b6c7bb1 service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:02.821887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c6529-8e05-440e-8bdd-70b28b6c7bb1 service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:02.821887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c6529-8e05-440e-8bdd-70b28b6c7bb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:02.831950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c6529-8e05-440e-8bdd-70b28b6c7bb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:02.833700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c6529-8e05-440e-8bdd-70b28b6c7bb1 service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:02.843200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1164/2323] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:31:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:31:03.172987 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe4dcd-fb4b-4d08-b570-a9eab26d6aff None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:03.173680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe4dcd-fb4b-4d08-b570-a9eab26d6aff None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:03.174161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe4dcd-fb4b-4d08-b570-a9eab26d6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:03.198276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ebfe4dcd-fb4b-4d08-b570-a9eab26d6aff None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:31:03.199650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ebfe4dcd-fb4b-4d08-b570-a9eab26d6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:03.220334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1160/2324] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:31:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:31:03.222289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c6529-8e05-440e-8bdd-70b28b6c7bb1 service swift] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:03.236514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c6529-8e05-440e-8bdd-70b28b6c7bb1 service swift] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:03.243052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c81b8-ae30-4b4d-9840-cc96a7dd1b6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:03.244019 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c81b8-ae30-4b4d-9840-cc96a7dd1b6b service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:03.244401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c81b8-ae30-4b4d-9840-cc96a7dd1b6b service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:03.244929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c81b8-ae30-4b4d-9840-cc96a7dd1b6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:03.261380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c81b8-ae30-4b4d-9840-cc96a7dd1b6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:03.263378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c81b8-ae30-4b4d-9840-cc96a7dd1b6b service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:03.273660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1165/2325] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:31:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:31:06.968187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe4dcd-fb4b-4d08-b570-a9eab26d6aff None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:06.969774 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ebfe4dcd-fb4b-4d08-b570-a9eab26d6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:06.985257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe4dcd-fb4b-4d08-b570-a9eab26d6aff None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:06.989924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710798e-7c11-41eb-9dc2-643ec5458a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:06.990879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710798e-7c11-41eb-9dc2-643ec5458a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:06.991903 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710798e-7c11-41eb-9dc2-643ec5458a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:06.992279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710798e-7c11-41eb-9dc2-643ec5458a4f admin admin] PATH_INFO: `/v3/users/e7d764501bed41d99941c6e083e19482` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:06.993505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710798e-7c11-41eb-9dc2-643ec5458a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d764501bed41d99941c6e083e19482)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:06.995584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710798e-7c11-41eb-9dc2-643ec5458a4f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:07.155453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5710798e-7c11-41eb-9dc2-643ec5458a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d764501bed41d99941c6e083e19482'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:31:07.171399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5710798e-7c11-41eb-9dc2-643ec5458a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d764501bed41d99941c6e083e19482'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:31:07.179206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5710798e-7c11-41eb-9dc2-643ec5458a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d764501bed41d99941c6e083e19482'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:31:07.180191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5710798e-7c11-41eb-9dc2-643ec5458a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d764501bed41d99941c6e083e19482'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:31:07.235809 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5710798e-7c11-41eb-9dc2-643ec5458a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d764501bed41d99941c6e083e19482'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:31:07.243827 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1161/2326] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:31:06 2022] DELETE /identity/v3/users/e7d764501bed41d99941c6e083e19482 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:31:07.521160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c81b8-ae30-4b4d-9840-cc96a7dd1b6b service swift] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:07.534705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c81b8-ae30-4b4d-9840-cc96a7dd1b6b service swift] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:07.640334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:07.641266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:07.641563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:07.641837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] PATH_INFO: `/v3/projects/f6fceef0782240ccb486341a9007e4b0` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:07.643284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6fceef0782240ccb486341a9007e4b0)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:07.645843 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:07.761285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6fceef0782240ccb486341a9007e4b0', 'request_id': 'req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:31:07.769568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6fceef0782240ccb486341a9007e4b0', 'request_id': 'req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:31:07.873309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6fceef0782240ccb486341a9007e4b0', 'request_id': 'req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:31:07.887372 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] The token cache is being invalidate because project f6fceef0782240ccb486341a9007e4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:31:07.888020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:31:07.888969 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-fbaf67aa-a3ce-4c3f-9f32-879e71addc1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:31:07.890800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1166/2327] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:31:07 2022] DELETE /identity/v3/projects/f6fceef0782240ccb486341a9007e4b0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:31:37.119572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573f730-de3b-4a8d-9603-1013e1b3c3f4 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:37.126803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573f730-de3b-4a8d-9603-1013e1b3c3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:37.126803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573f730-de3b-4a8d-9603-1013e1b3c3f4 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:37.126803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1162/2328] 10.222.0.64 () {54 vars in 921 bytes} [Fri May 13 17:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:31:37.128211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39107332-e068-45e9-91dd-f669333ad752 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:37.128671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39107332-e068-45e9-91dd-f669333ad752 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:37.128767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39107332-e068-45e9-91dd-f669333ad752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:37.165515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-39107332-e068-45e9-91dd-f669333ad752 None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:31:37.166736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-39107332-e068-45e9-91dd-f669333ad752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:37.239751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1167/2329] 10.222.0.64 () {58 vars in 1018 bytes} [Fri May 13 17:31:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:31:37.251453 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573f730-de3b-4a8d-9603-1013e1b3c3f4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:37.253444 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9573f730-de3b-4a8d-9603-1013e1b3c3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:37.332157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573f730-de3b-4a8d-9603-1013e1b3c3f4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:37.336329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae6c67-7281-4dad-9125-4b20f9a1bb85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e00de466abe41da8e6d7dbbd71f5270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:37.336975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6c67-7281-4dad-9125-4b20f9a1bb85 service glance] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:37.337276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6c67-7281-4dad-9125-4b20f9a1bb85 service glance] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:37.337557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6c67-7281-4dad-9125-4b20f9a1bb85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:37.348201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae6c67-7281-4dad-9125-4b20f9a1bb85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:37.350078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae6c67-7281-4dad-9125-4b20f9a1bb85 service glance] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:37.360898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1163/2330] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:31:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:31:37.602395 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026f231-c25f-49b3-98b3-f752d617be68 None None] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:37.602695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026f231-c25f-49b3-98b3-f752d617be68 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:37.602982 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026f231-c25f-49b3-98b3-f752d617be68 None None] PATH_INFO: `/` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:37.604431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1168/2331] 10.222.0.64 () {54 vars in 921 bytes} [Fri May 13 17:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:31:37.609411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f591e-eaf0-48cf-aab0-ce2f7056efd6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:37.609732 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f591e-eaf0-48cf-aab0-ce2f7056efd6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:37.610043 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f591e-eaf0-48cf-aab0-ce2f7056efd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:37.629680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-774f591e-eaf0-48cf-aab0-ce2f7056efd6 None None] MFA Rules not processed for user `d99855838f77462886cc87db440e1037`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:31:37.630895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-774f591e-eaf0-48cf-aab0-ce2f7056efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:37.682608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1164/2332] 10.222.0.64 () {58 vars in 1018 bytes} [Fri May 13 17:31:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:31:37.694031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026f231-c25f-49b3-98b3-f752d617be68 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:37.696292 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3026f231-c25f-49b3-98b3-f752d617be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:37.709419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026f231-c25f-49b3-98b3-f752d617be68 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:37.713272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134e15e-8ac9-43f5-8574-18405e0d60b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:37.713917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134e15e-8ac9-43f5-8574-18405e0d60b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:37.714204 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134e15e-8ac9-43f5-8574-18405e0d60b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:37.714484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134e15e-8ac9-43f5-8574-18405e0d60b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:37.721637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134e15e-8ac9-43f5-8574-18405e0d60b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:37.723378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134e15e-8ac9-43f5-8574-18405e0d60b2 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:37.732068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1169/2333] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:31:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:31:37.813182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfd2e3-b121-4461-8a36-ea9cf0a383b9 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:37.813474 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfd2e3-b121-4461-8a36-ea9cf0a383b9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:37.813756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfd2e3-b121-4461-8a36-ea9cf0a383b9 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:37.815203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1165/2334] 10.222.0.64 () {54 vars in 921 bytes} [Fri May 13 17:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 17:31:37.819877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21930e-ba47-47b4-9120-d28a90dbdf10 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:37.820831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21930e-ba47-47b4-9120-d28a90dbdf10 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:37.821034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21930e-ba47-47b4-9120-d28a90dbdf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:37.839388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-8c21930e-ba47-47b4-9120-d28a90dbdf10 None None] MFA Rules not processed for user `efbbecde248c44c7b1d5f3c9522a48a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:31:37.840579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8c21930e-ba47-47b4-9120-d28a90dbdf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:37.850255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1170/2335] 10.222.0.64 () {58 vars in 1018 bytes} [Fri May 13 17:31:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:31:37.860362 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfd2e3-b121-4461-8a36-ea9cf0a383b9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:37.871650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfd2e3-b121-4461-8a36-ea9cf0a383b9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:37.876755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03426e78-36b6-431b-9a5c-b7053b4789a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:37.876755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03426e78-36b6-431b-9a5c-b7053b4789a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:37.876755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03426e78-36b6-431b-9a5c-b7053b4789a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:37.876755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03426e78-36b6-431b-9a5c-b7053b4789a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:37.886887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03426e78-36b6-431b-9a5c-b7053b4789a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:37.888379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03426e78-36b6-431b-9a5c-b7053b4789a8 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:37.898838 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1166/2336] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:31:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:31:40.602970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21930e-ba47-47b4-9120-d28a90dbdf10 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:40.612274 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21930e-ba47-47b4-9120-d28a90dbdf10 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:40.615925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332fe81-a05b-4855-bd00-0bfb71447fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:40.616598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332fe81-a05b-4855-bd00-0bfb71447fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:40.617364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332fe81-a05b-4855-bd00-0bfb71447fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:40.617642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332fe81-a05b-4855-bd00-0bfb71447fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:40.619423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0332fe81-a05b-4855-bd00-0bfb71447fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:40.632708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332fe81-a05b-4855-bd00-0bfb71447fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:40.634638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332fe81-a05b-4855-bd00-0bfb71447fa4 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:40.646188 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1171/2337] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:31:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:31:40.724930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03426e78-36b6-431b-9a5c-b7053b4789a8 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:40.726382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-03426e78-36b6-431b-9a5c-b7053b4789a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:40.737928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03426e78-36b6-431b-9a5c-b7053b4789a8 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:40.742329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fc8dc-2741-4cf0-88c7-cc38077a1181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:40.742993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc8dc-2741-4cf0-88c7-cc38077a1181 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:40.743386 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc8dc-2741-4cf0-88c7-cc38077a1181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:40.743667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc8dc-2741-4cf0-88c7-cc38077a1181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:40.745500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9c9fc8dc-2741-4cf0-88c7-cc38077a1181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:40.760929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fc8dc-2741-4cf0-88c7-cc38077a1181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:40.762458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fc8dc-2741-4cf0-88c7-cc38077a1181 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:40.775274 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1167/2338] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:31:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:31:48.201102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc8c86-a708-4454-9150-2475d9bd89f4 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:48.201631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc8c86-a708-4454-9150-2475d9bd89f4 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:48.201731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc8c86-a708-4454-9150-2475d9bd89f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:48.220086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-31dc8c86-a708-4454-9150-2475d9bd89f4 None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:31:48.221308 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-31dc8c86-a708-4454-9150-2475d9bd89f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:48.274614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1172/2339] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:31:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:31:48.296539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fc8dc-2741-4cf0-88c7-cc38077a1181 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:48.299694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9c9fc8dc-2741-4cf0-88c7-cc38077a1181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:48.376245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fc8dc-2741-4cf0-88c7-cc38077a1181 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:48.381216 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df3b36-915e-4d53-91e2-96483d214038 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:48.381867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3b36-915e-4d53-91e2-96483d214038 service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:48.382152 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3b36-915e-4d53-91e2-96483d214038 service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:48.382429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3b36-915e-4d53-91e2-96483d214038 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:48.390327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df3b36-915e-4d53-91e2-96483d214038 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:48.391969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df3b36-915e-4d53-91e2-96483d214038 service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:48.400330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1168/2340] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:31:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:31:50.157997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc8c86-a708-4454-9150-2475d9bd89f4 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:50.159590 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-31dc8c86-a708-4454-9150-2475d9bd89f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:50.174941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc8c86-a708-4454-9150-2475d9bd89f4 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:50.180537 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b5b16-442e-4bc2-bf90-bba52c55167c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:50.181197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b5b16-442e-4bc2-bf90-bba52c55167c service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:50.181489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b5b16-442e-4bc2-bf90-bba52c55167c service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:50.181785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b5b16-442e-4bc2-bf90-bba52c55167c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:50.183730 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b97b5b16-442e-4bc2-bf90-bba52c55167c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:50.255242 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b5b16-442e-4bc2-bf90-bba52c55167c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:50.255242 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b5b16-442e-4bc2-bf90-bba52c55167c service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:50.260817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1173/2341] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:31:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:31:57.704165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64a707-98c4-4841-8e48-d77803207753 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:57.704771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64a707-98c4-4841-8e48-d77803207753 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:57.705073 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64a707-98c4-4841-8e48-d77803207753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:57.724738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0c64a707-98c4-4841-8e48-d77803207753 None None] MFA Rules not processed for user `00983ee7706f43d4b3f7d0f178c0e924`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:31:57.725949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0c64a707-98c4-4841-8e48-d77803207753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:57.789344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1169/2342] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:31:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:31:58.218019 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b5b16-442e-4bc2-bf90-bba52c55167c service nova] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:58.227494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b5b16-442e-4bc2-bf90-bba52c55167c service nova] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:58.231714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc6336-8336-4f92-b5d8-c9182309a813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:58.232409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6336-8336-4f92-b5d8-c9182309a813 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:58.232705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6336-8336-4f92-b5d8-c9182309a813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:58.232984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc6336-8336-4f92-b5d8-c9182309a813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:58.234794 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c3cc6336-8336-4f92-b5d8-c9182309a813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:58.245468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc6336-8336-4f92-b5d8-c9182309a813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:58.250327 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc6336-8336-4f92-b5d8-c9182309a813 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:58.260420 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1174/2343] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:31:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:31:58.673729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64a707-98c4-4841-8e48-d77803207753 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:31:58.676306 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0c64a707-98c4-4841-8e48-d77803207753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:58.769766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64a707-98c4-4841-8e48-d77803207753 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:31:58.774666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d575a-fe44-43c6-a2db-f7e7acf052bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84ae21424694df68a96b928e15e9240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:31:58.775875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d575a-fe44-43c6-a2db-f7e7acf052bd service placement] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:31:58.776161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d575a-fe44-43c6-a2db-f7e7acf052bd service placement] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:31:58.776469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d575a-fe44-43c6-a2db-f7e7acf052bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:31:58.778255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-209d575a-fe44-43c6-a2db-f7e7acf052bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:31:58.789893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d575a-fe44-43c6-a2db-f7e7acf052bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:31:58.792238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d575a-fe44-43c6-a2db-f7e7acf052bd service placement] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:31:58.802447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1170/2344] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:31:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:32:12.373071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc6336-8336-4f92-b5d8-c9182309a813 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:32:12.381690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc6336-8336-4f92-b5d8-c9182309a813 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:32:12.385317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea0df-9430-4ed5-b96a-dbb0475d4714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:32:12.385953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea0df-9430-4ed5-b96a-dbb0475d4714 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:32:12.386232 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea0df-9430-4ed5-b96a-dbb0475d4714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:32:12.386505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea0df-9430-4ed5-b96a-dbb0475d4714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:32:12.388261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a27ea0df-9430-4ed5-b96a-dbb0475d4714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:32:12.397476 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea0df-9430-4ed5-b96a-dbb0475d4714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:32:12.399111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea0df-9430-4ed5-b96a-dbb0475d4714 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:32:12.407571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1175/2345] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:32:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:32:13.188961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d575a-fe44-43c6-a2db-f7e7acf052bd service placement] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:32:13.202500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d575a-fe44-43c6-a2db-f7e7acf052bd service placement] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:32:13.207414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2b1bf-284b-4f62-bd81-5cd47ff67ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:32:13.208064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2b1bf-284b-4f62-bd81-5cd47ff67ae7 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:32:13.208407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2b1bf-284b-4f62-bd81-5cd47ff67ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:32:13.208716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2b1bf-284b-4f62-bd81-5cd47ff67ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:32:13.210508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d9c2b1bf-284b-4f62-bd81-5cd47ff67ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:32:13.222740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2b1bf-284b-4f62-bd81-5cd47ff67ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:32:13.224637 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2b1bf-284b-4f62-bd81-5cd47ff67ae7 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:32:13.235457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1171/2346] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:32:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:32:25.032484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea0df-9430-4ed5-b96a-dbb0475d4714 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:32:25.033950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a27ea0df-9430-4ed5-b96a-dbb0475d4714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:32:25.050039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea0df-9430-4ed5-b96a-dbb0475d4714 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:32:25.055391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbecc2-35df-433b-9355-c1a3cacb52e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:32:25.056025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbecc2-35df-433b-9355-c1a3cacb52e6 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:32:25.056310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbecc2-35df-433b-9355-c1a3cacb52e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:32:25.056586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbecc2-35df-433b-9355-c1a3cacb52e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:32:25.058270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a2dbecc2-35df-433b-9355-c1a3cacb52e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:32:25.069794 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbecc2-35df-433b-9355-c1a3cacb52e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:32:25.071407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbecc2-35df-433b-9355-c1a3cacb52e6 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:32:25.082417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1176/2347] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:32:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:32:32.260772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e53ed0-e85f-4503-9b2f-b0b44698dfb6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:32:32.261209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e53ed0-e85f-4503-9b2f-b0b44698dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:32:32.261463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e53ed0-e85f-4503-9b2f-b0b44698dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:32:32.279938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a0e53ed0-e85f-4503-9b2f-b0b44698dfb6 None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:32:32.281652 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a0e53ed0-e85f-4503-9b2f-b0b44698dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:32:32.288837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1172/2348] 10.222.0.64 () {58 vars in 967 bytes} [Fri May 13 17:32:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:32:32.301808 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbecc2-35df-433b-9355-c1a3cacb52e6 service nova] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:32:32.312830 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbecc2-35df-433b-9355-c1a3cacb52e6 service nova] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:32:32.317811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2e1bc-792d-41d4-b034-cc3142b0e807 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:32:32.318454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2e1bc-792d-41d4-b034-cc3142b0e807 service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:32:32.318739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2e1bc-792d-41d4-b034-cc3142b0e807 service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:32:32.319025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2e1bc-792d-41d4-b034-cc3142b0e807 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:32:32.326876 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2e1bc-792d-41d4-b034-cc3142b0e807 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:32:32.328576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2e1bc-792d-41d4-b034-cc3142b0e807 service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:32:32.336469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1177/2349] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:32:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:33:25.002988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e53ed0-e85f-4503-9b2f-b0b44698dfb6 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:33:25.015704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e53ed0-e85f-4503-9b2f-b0b44698dfb6 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:33:25.021296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5d961-994e-4b02-868c-a619ec8e828d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:33:25.022024 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5d961-994e-4b02-868c-a619ec8e828d service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:33:25.022395 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5d961-994e-4b02-868c-a619ec8e828d service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:33:25.022598 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5d961-994e-4b02-868c-a619ec8e828d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:33:25.024461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-52a5d961-994e-4b02-868c-a619ec8e828d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:33:25.091227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5d961-994e-4b02-868c-a619ec8e828d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:33:25.092941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5d961-994e-4b02-868c-a619ec8e828d service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:33:25.104800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1173/2350] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:33:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:33:30.147036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2e1bc-792d-41d4-b034-cc3142b0e807 service swift] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:33:30.149406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-47e2e1bc-792d-41d4-b034-cc3142b0e807 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:33:30.214247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2e1bc-792d-41d4-b034-cc3142b0e807 service swift] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:33:30.218786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:33:30.219691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:33:30.219977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:33:30.220252 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] PATH_INFO: `/v3/users/00983ee7706f43d4b3f7d0f178c0e924` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:33:30.221440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=00983ee7706f43d4b3f7d0f178c0e924)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:33:30.223422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:33:30.415735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00983ee7706f43d4b3f7d0f178c0e924'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:33:30.427238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00983ee7706f43d4b3f7d0f178c0e924'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:33:30.427909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00983ee7706f43d4b3f7d0f178c0e924'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:33:30.511478 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00983ee7706f43d4b3f7d0f178c0e924'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:33:30.518817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00983ee7706f43d4b3f7d0f178c0e924'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:33:30.524719 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1178/2351] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:33:30 2022] DELETE /identity/v3/users/00983ee7706f43d4b3f7d0f178c0e924 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:33:30.775288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5d961-994e-4b02-868c-a619ec8e828d service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:33:30.786055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5d961-994e-4b02-868c-a619ec8e828d service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:33:30.844241 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:33:30.845098 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:33:30.845378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:33:30.845648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] PATH_INFO: `/v3/projects/e9f5f08db8cb40f0857115f4c9aadaf7` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:33:30.846803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f5f08db8cb40f0857115f4c9aadaf7)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:33:30.849075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:33:30.954029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'request_id': 'req-16fec3f3-48b7-455a-85e9-3b7c46ebed44'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:33:30.959860 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'request_id': 'req-16fec3f3-48b7-455a-85e9-3b7c46ebed44'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:33:31.029027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'request_id': 'req-16fec3f3-48b7-455a-85e9-3b7c46ebed44'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:33:31.040459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] The token cache is being invalidate because project e9f5f08db8cb40f0857115f4c9aadaf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:33:31.040750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:33:31.041894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:33:31.043483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1174/2352] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:33:30 2022] DELETE /identity/v3/projects/e9f5f08db8cb40f0857115f4c9aadaf7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:33:38.962938 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:33:38.964462 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:33:39.037482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc8a0-0e33-46ce-84df-eb31c082dbde admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:33:39.097103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c6be0-6ca5-4c11-8c93-c3fe6523ce2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:33:39.097757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c6be0-6ca5-4c11-8c93-c3fe6523ce2d service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:33:39.098041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c6be0-6ca5-4c11-8c93-c3fe6523ce2d service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:33:39.098320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c6be0-6ca5-4c11-8c93-c3fe6523ce2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:33:39.100652 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-433c6be0-6ca5-4c11-8c93-c3fe6523ce2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:33:39.155659 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c6be0-6ca5-4c11-8c93-c3fe6523ce2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:33:39.157289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c6be0-6ca5-4c11-8c93-c3fe6523ce2d service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:33:39.166191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1179/2353] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:33:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:33:48.423503 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:33:48.424904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:33:48.440846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fec3f3-48b7-455a-85e9-3b7c46ebed44 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:33:48.446298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f159a0-8290-4de8-b995-a8fbd0b0837f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:33:48.446929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f159a0-8290-4de8-b995-a8fbd0b0837f service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:33:48.447245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f159a0-8290-4de8-b995-a8fbd0b0837f service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:33:48.447525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f159a0-8290-4de8-b995-a8fbd0b0837f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:33:48.449222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-34f159a0-8290-4de8-b995-a8fbd0b0837f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:33:48.505533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f159a0-8290-4de8-b995-a8fbd0b0837f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:33:48.507193 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f159a0-8290-4de8-b995-a8fbd0b0837f service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:33:48.518797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1175/2354] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:33:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:33:55.769036 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b0c5-595b-431e-a2e5-7ab1c963bff9 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:33:55.769542 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b0c5-595b-431e-a2e5-7ab1c963bff9 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:33:55.769672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b0c5-595b-431e-a2e5-7ab1c963bff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:33:55.786534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-53e9b0c5-595b-431e-a2e5-7ab1c963bff9 None None] MFA Rules not processed for user `dfc52b61bcf845d1953a5a111abb3666`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:33:55.787812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-53e9b0c5-595b-431e-a2e5-7ab1c963bff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:33:55.794847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1180/2355] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:33:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:33:56.098314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f159a0-8290-4de8-b995-a8fbd0b0837f service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:33:56.100022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-34f159a0-8290-4de8-b995-a8fbd0b0837f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:33:56.155079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f159a0-8290-4de8-b995-a8fbd0b0837f service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:33:56.158669 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32283422-a23c-4c82-8cdc-f08ea339e23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:33:56.159338 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32283422-a23c-4c82-8cdc-f08ea339e23e service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:33:56.159622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32283422-a23c-4c82-8cdc-f08ea339e23e service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:33:56.159901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32283422-a23c-4c82-8cdc-f08ea339e23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:33:56.161643 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-32283422-a23c-4c82-8cdc-f08ea339e23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:33:56.170740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32283422-a23c-4c82-8cdc-f08ea339e23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:33:56.172231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32283422-a23c-4c82-8cdc-f08ea339e23e service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:33:56.180905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1176/2356] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:33:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:34:11.562780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09044f8-2396-41ef-9c2d-508551bebeda None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:11.563319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09044f8-2396-41ef-9c2d-508551bebeda None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:11.563426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09044f8-2396-41ef-9c2d-508551bebeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:11.582973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d09044f8-2396-41ef-9c2d-508551bebeda None None] MFA Rules not processed for user `57f36ff6dbd24787baf10788bdf8a1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:34:11.584224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d09044f8-2396-41ef-9c2d-508551bebeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:11.640125 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1181/2357] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:34:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:34:13.147442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32283422-a23c-4c82-8cdc-f08ea339e23e service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:13.160603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32283422-a23c-4c82-8cdc-f08ea339e23e service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:13.166212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66fe49-926c-4a4e-8688-eed81623bc9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:13.185378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66fe49-926c-4a4e-8688-eed81623bc9c service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:13.185378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66fe49-926c-4a4e-8688-eed81623bc9c service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:13.185378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66fe49-926c-4a4e-8688-eed81623bc9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:13.185378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8f66fe49-926c-4a4e-8688-eed81623bc9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:13.185378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66fe49-926c-4a4e-8688-eed81623bc9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:13.185378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66fe49-926c-4a4e-8688-eed81623bc9c service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:13.194273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1177/2358] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:34:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:34:21.839224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09044f8-2396-41ef-9c2d-508551bebeda None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:21.840688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d09044f8-2396-41ef-9c2d-508551bebeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:21.856302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09044f8-2396-41ef-9c2d-508551bebeda None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:21.861629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c45d5-32c7-474a-a7b4-9c41d8506248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:21.862258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c45d5-32c7-474a-a7b4-9c41d8506248 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:21.863034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c45d5-32c7-474a-a7b4-9c41d8506248 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:21.863339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c45d5-32c7-474a-a7b4-9c41d8506248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:21.865004 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-557c45d5-32c7-474a-a7b4-9c41d8506248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:21.926384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c45d5-32c7-474a-a7b4-9c41d8506248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:21.928012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c45d5-32c7-474a-a7b4-9c41d8506248 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:21.936657 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1182/2359] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:34:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:34:23.577964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e8e71-2e51-42b7-8cbb-3b8c4f89c031 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:23.578495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e8e71-2e51-42b7-8cbb-3b8c4f89c031 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:23.578495 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e8e71-2e51-42b7-8cbb-3b8c4f89c031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:23.596005 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-aa5e8e71-2e51-42b7-8cbb-3b8c4f89c031 None None] MFA Rules not processed for user `a0294c57ba3f41bc8cf2cac294bb678c`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:34:23.597195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-aa5e8e71-2e51-42b7-8cbb-3b8c4f89c031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:23.605823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1178/2360] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:34:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:34:34.316837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c45d5-32c7-474a-a7b4-9c41d8506248 service nova] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:34.328601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c45d5-32c7-474a-a7b4-9c41d8506248 service nova] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:34.334174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f554dc-75cd-416a-a6b6-879a275a527f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:34.334824 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f554dc-75cd-416a-a6b6-879a275a527f service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:34.335111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f554dc-75cd-416a-a6b6-879a275a527f service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:34.335424 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f554dc-75cd-416a-a6b6-879a275a527f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:34.337219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d5f554dc-75cd-416a-a6b6-879a275a527f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:34.394437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f554dc-75cd-416a-a6b6-879a275a527f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:34.396140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f554dc-75cd-416a-a6b6-879a275a527f service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:34.405278 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1183/2361] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:34:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:34:46.406524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b516-0c88-4edc-a853-14758f4925ed None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:46.406985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b516-0c88-4edc-a853-14758f4925ed None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:46.407088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b516-0c88-4edc-a853-14758f4925ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:46.427921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d5d0b516-0c88-4edc-a853-14758f4925ed None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:34:46.429304 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d5d0b516-0c88-4edc-a853-14758f4925ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:46.485268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1179/2362] 10.222.0.64 () {58 vars in 967 bytes} [Fri May 13 17:34:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:34:46.616114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f554dc-75cd-416a-a6b6-879a275a527f service nova] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:46.617549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d5f554dc-75cd-416a-a6b6-879a275a527f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:46.687546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f554dc-75cd-416a-a6b6-879a275a527f service nova] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:46.692968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6213faf-d5a3-4d77-b7d0-c199e14bae46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:46.693627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213faf-d5a3-4d77-b7d0-c199e14bae46 service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:46.693918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213faf-d5a3-4d77-b7d0-c199e14bae46 service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:46.694202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213faf-d5a3-4d77-b7d0-c199e14bae46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:46.703606 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6213faf-d5a3-4d77-b7d0-c199e14bae46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:46.705255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6213faf-d5a3-4d77-b7d0-c199e14bae46 service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:46.713755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1184/2363] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:34:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:34:47.690837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0b516-0c88-4edc-a853-14758f4925ed None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:47.701218 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0b516-0c88-4edc-a853-14758f4925ed None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:47.704837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828768e-d516-43b7-abfc-b2f985698bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:47.705552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828768e-d516-43b7-abfc-b2f985698bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:47.705908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828768e-d516-43b7-abfc-b2f985698bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:47.706263 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828768e-d516-43b7-abfc-b2f985698bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:47.708124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3828768e-d516-43b7-abfc-b2f985698bf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:47.774985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828768e-d516-43b7-abfc-b2f985698bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:47.776529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828768e-d516-43b7-abfc-b2f985698bf6 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:47.786282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1180/2364] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:34:56.232887 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6213faf-d5a3-4d77-b7d0-c199e14bae46 service swift] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:56.234381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f6213faf-d5a3-4d77-b7d0-c199e14bae46 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:56.248418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6213faf-d5a3-4d77-b7d0-c199e14bae46 service swift] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:56.252980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:56.253856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:56.254140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:56.254414 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] PATH_INFO: `/v3/users/bf8f7f47fe6c4a88b415ec21b36fcdd9` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:56.255629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8f7f47fe6c4a88b415ec21b36fcdd9)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:56.257568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:56.455410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8f7f47fe6c4a88b415ec21b36fcdd9'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:56.470274 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8f7f47fe6c4a88b415ec21b36fcdd9'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:56.471043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8f7f47fe6c4a88b415ec21b36fcdd9'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:56.560880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8f7f47fe6c4a88b415ec21b36fcdd9'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:56.568955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8f7f47fe6c4a88b415ec21b36fcdd9'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:56.575057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1185/2365] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:34:56 2022] DELETE /identity/v3/users/bf8f7f47fe6c4a88b415ec21b36fcdd9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:34:56.791477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828768e-d516-43b7-abfc-b2f985698bf6 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:56.801436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828768e-d516-43b7-abfc-b2f985698bf6 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:56.858824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:56.859715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:56.859995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:56.860267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] PATH_INFO: `/v3/projects/aff066fb75f04eb7bb9b16dea32b270d` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:56.861421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff066fb75f04eb7bb9b16dea32b270d)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:56.863380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:56.971088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff066fb75f04eb7bb9b16dea32b270d', 'request_id': 'req-c20ddb91-9962-4917-b7bf-5e2cc297ce74'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:56.976516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff066fb75f04eb7bb9b16dea32b270d', 'request_id': 'req-c20ddb91-9962-4917-b7bf-5e2cc297ce74'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.069270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff066fb75f04eb7bb9b16dea32b270d', 'request_id': 'req-c20ddb91-9962-4917-b7bf-5e2cc297ce74'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.081109 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] The token cache is being invalidate because project aff066fb75f04eb7bb9b16dea32b270d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:34:57.081393 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.082008 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.083607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1181/2366] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:34:56 2022] DELETE /identity/v3/projects/aff066fb75f04eb7bb9b16dea32b270d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:34:57.088173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:57.089606 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:57.103357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db4653-5e86-4ed6-a9bd-9e42a44c8e81 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:57.162739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e1003-d43f-4a8f-af1f-68fce5b09476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:57.163639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1003-d43f-4a8f-af1f-68fce5b09476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:57.163922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1003-d43f-4a8f-af1f-68fce5b09476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:57.164197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1003-d43f-4a8f-af1f-68fce5b09476 admin admin] PATH_INFO: `/v3/users/30fd99ac3599453fb10311cc1bbba403` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:57.165366 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e1003-d43f-4a8f-af1f-68fce5b09476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30fd99ac3599453fb10311cc1bbba403)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:57.167494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e1003-d43f-4a8f-af1f-68fce5b09476 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:57.322798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8c9e1003-d43f-4a8f-af1f-68fce5b09476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30fd99ac3599453fb10311cc1bbba403'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.334472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8c9e1003-d43f-4a8f-af1f-68fce5b09476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30fd99ac3599453fb10311cc1bbba403'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.335134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8c9e1003-d43f-4a8f-af1f-68fce5b09476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30fd99ac3599453fb10311cc1bbba403'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.416757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8c9e1003-d43f-4a8f-af1f-68fce5b09476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30fd99ac3599453fb10311cc1bbba403'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.423641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8c9e1003-d43f-4a8f-af1f-68fce5b09476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30fd99ac3599453fb10311cc1bbba403'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.429424 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1186/2367] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:34:57 2022] DELETE /identity/v3/users/30fd99ac3599453fb10311cc1bbba403 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:34:57.681662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:57.683320 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:57.700788 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ddb91-9962-4917-b7bf-5e2cc297ce74 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:57.769179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:57.770203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:57.770468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:57.770726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] PATH_INFO: `/v3/projects/c2d398586c0d470bb12b8fde402dfa0b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:57.771944 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d398586c0d470bb12b8fde402dfa0b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:57.773881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:57.852335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d398586c0d470bb12b8fde402dfa0b', 'request_id': 'req-b5ed4073-c886-4e86-a4a0-7c6307199d7b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.857766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d398586c0d470bb12b8fde402dfa0b', 'request_id': 'req-b5ed4073-c886-4e86-a4a0-7c6307199d7b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.915149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d398586c0d470bb12b8fde402dfa0b', 'request_id': 'req-b5ed4073-c886-4e86-a4a0-7c6307199d7b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.927245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] The token cache is being invalidate because project c2d398586c0d470bb12b8fde402dfa0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:34:57.927540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.928185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b5ed4073-c886-4e86-a4a0-7c6307199d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:34:57.929726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1182/2368] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:34:57 2022] DELETE /identity/v3/projects/c2d398586c0d470bb12b8fde402dfa0b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:34:57.934767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0a8cc-09bd-49cd-9fdf-76deb641a0b2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:57.935057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0a8cc-09bd-49cd-9fdf-76deb641a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:57.935367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0a8cc-09bd-49cd-9fdf-76deb641a0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:57.954137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-52e0a8cc-09bd-49cd-9fdf-76deb641a0b2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:34:57.955493 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-52e0a8cc-09bd-49cd-9fdf-76deb641a0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:58.032627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1187/2369] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:34:58.040532 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c459b-1ef2-4694-9997-d5ff8373efa4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:58.040832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c459b-1ef2-4694-9997-d5ff8373efa4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:58.041106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c459b-1ef2-4694-9997-d5ff8373efa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:58.058814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-315c459b-1ef2-4694-9997-d5ff8373efa4 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:34:58.061658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-315c459b-1ef2-4694-9997-d5ff8373efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:58.068291 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1183/2370] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:34:58.073070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0a8cc-09bd-49cd-9fdf-76deb641a0b2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:58.082807 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0a8cc-09bd-49cd-9fdf-76deb641a0b2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:58.087428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc79e9e-a978-44d9-a9ef-e7f235d138a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:58.088732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79e9e-a978-44d9-a9ef-e7f235d138a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:58.089013 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79e9e-a978-44d9-a9ef-e7f235d138a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:58.089285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79e9e-a978-44d9-a9ef-e7f235d138a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:58.090005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc79e9e-a978-44d9-a9ef-e7f235d138a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:34:58.090312 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc79e9e-a978-44d9-a9ef-e7f235d138a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:58.092001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc79e9e-a978-44d9-a9ef-e7f235d138a0 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:58.105333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1188/2371] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:34:58.108392 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c459b-1ef2-4694-9997-d5ff8373efa4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:58.117393 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c459b-1ef2-4694-9997-d5ff8373efa4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:58.122844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89119800-094c-41bd-8219-65e3c12c8e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:58.123536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119800-094c-41bd-8219-65e3c12c8e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:58.123820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119800-094c-41bd-8219-65e3c12c8e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:58.124094 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119800-094c-41bd-8219-65e3c12c8e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:58.124791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89119800-094c-41bd-8219-65e3c12c8e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:58.126741 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89119800-094c-41bd-8219-65e3c12c8e56 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:58.237146 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1184/2372] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:34:58 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:34:58.241010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc79e9e-a978-44d9-a9ef-e7f235d138a0 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:58.251731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc79e9e-a978-44d9-a9ef-e7f235d138a0 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:58.308205 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04ec77-19db-4671-a09c-c6d2f4e42dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:58.308980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04ec77-19db-4671-a09c-c6d2f4e42dcf admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:58.309339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04ec77-19db-4671-a09c-c6d2f4e42dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:58.309626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04ec77-19db-4671-a09c-c6d2f4e42dcf admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:58.310328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04ec77-19db-4671-a09c-c6d2f4e42dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:58.312396 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04ec77-19db-4671-a09c-c6d2f4e42dcf admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:58.428829 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1189/2373] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:34:58 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:34:58.433932 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89119800-094c-41bd-8219-65e3c12c8e56 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:58.444924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89119800-094c-41bd-8219-65e3c12c8e56 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:58.450220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d16a06-5327-4a98-92c5-a30ca67cc2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:58.450945 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d16a06-5327-4a98-92c5-a30ca67cc2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:58.451256 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d16a06-5327-4a98-92c5-a30ca67cc2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:58.451650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d16a06-5327-4a98-92c5-a30ca67cc2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:58.454787 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d16a06-5327-4a98-92c5-a30ca67cc2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:58.455497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d16a06-5327-4a98-92c5-a30ca67cc2c6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:58.466543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1185/2374] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:34:58.470327 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04ec77-19db-4671-a09c-c6d2f4e42dcf admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:58.481490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04ec77-19db-4671-a09c-c6d2f4e42dcf admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:58.486433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134c262-2221-4135-96e7-999a1b0e6da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:58.487097 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c262-2221-4135-96e7-999a1b0e6da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:58.487418 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c262-2221-4135-96e7-999a1b0e6da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:58.487704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c262-2221-4135-96e7-999a1b0e6da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:58.488431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134c262-2221-4135-96e7-999a1b0e6da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:58.490580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134c262-2221-4135-96e7-999a1b0e6da2 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:58.501364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1190/2375] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:34:58.505603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d16a06-5327-4a98-92c5-a30ca67cc2c6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:58.516250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d16a06-5327-4a98-92c5-a30ca67cc2c6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:58.521066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b382a-72dd-4818-bc38-92f425f71b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:58.521949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b382a-72dd-4818-bc38-92f425f71b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:58.522236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b382a-72dd-4818-bc38-92f425f71b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:58.522512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b382a-72dd-4818-bc38-92f425f71b31 admin admin] PATH_INFO: `/v3/projects/60fd06693c624da5aa61222dfbde5b25/users/45482c562be6438ebd456ee9512ef3e8/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:58.537582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b382a-72dd-4818-bc38-92f425f71b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fd06693c624da5aa61222dfbde5b25, user_id=45482c562be6438ebd456ee9512ef3e8, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:58.543239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b382a-72dd-4818-bc38-92f425f71b31 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:58.618508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1186/2376] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:34:58 2022] PUT /identity/v3/projects/60fd06693c624da5aa61222dfbde5b25/users/45482c562be6438ebd456ee9512ef3e8/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:34:58.624272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25cb5-afe9-49d0-9263-ee92665ae740 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:58.624574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25cb5-afe9-49d0-9263-ee92665ae740 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:58.624858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25cb5-afe9-49d0-9263-ee92665ae740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:58.644052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-fad25cb5-afe9-49d0-9263-ee92665ae740 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:34:58.645283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fad25cb5-afe9-49d0-9263-ee92665ae740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:58.704216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1191/2377] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:34:58.713911 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b382a-72dd-4818-bc38-92f425f71b31 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:58.715738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f42b382a-72dd-4818-bc38-92f425f71b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:58.831577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b382a-72dd-4818-bc38-92f425f71b31 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:58.844139 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e420-95f0-45f5-8ae8-eff4acdf8d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:58.844819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e420-95f0-45f5-8ae8-eff4acdf8d1f service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:58.845107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e420-95f0-45f5-8ae8-eff4acdf8d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:58.845387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e420-95f0-45f5-8ae8-eff4acdf8d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:58.859395 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e420-95f0-45f5-8ae8-eff4acdf8d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:58.861059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e420-95f0-45f5-8ae8-eff4acdf8d1f service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:58.872588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1187/2378] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:34:59.589715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25cb5-afe9-49d0-9263-ee92665ae740 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:34:59.591157 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fad25cb5-afe9-49d0-9263-ee92665ae740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:59.664180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25cb5-afe9-49d0-9263-ee92665ae740 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:34:59.670159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0e5d2-ff61-4ba4-86bf-8105deee4d1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84ae21424694df68a96b928e15e9240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:34:59.671039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0e5d2-ff61-4ba4-86bf-8105deee4d1c service placement] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:34:59.671360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0e5d2-ff61-4ba4-86bf-8105deee4d1c service placement] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:34:59.671642 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0e5d2-ff61-4ba4-86bf-8105deee4d1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:34:59.676408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-02a0e5d2-ff61-4ba4-86bf-8105deee4d1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:34:59.689104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0e5d2-ff61-4ba4-86bf-8105deee4d1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:34:59.691011 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0e5d2-ff61-4ba4-86bf-8105deee4d1c service placement] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:34:59.702133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1192/2379] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:34:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:35:04.735577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9137a-6ca9-44b1-93de-ffe630dbba3c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:35:04.735577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9137a-6ca9-44b1-93de-ffe630dbba3c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:35:04.735577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9137a-6ca9-44b1-93de-ffe630dbba3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:35:04.739910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed6c98-aae2-405d-be83-fd047af78811 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:35:04.740377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed6c98-aae2-405d-be83-fd047af78811 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:35:04.742511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed6c98-aae2-405d-be83-fd047af78811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:35:04.768138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5ab9137a-6ca9-44b1-93de-ffe630dbba3c None None] MFA Rules not processed for user `45482c562be6438ebd456ee9512ef3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:35:04.771165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d0ed6c98-aae2-405d-be83-fd047af78811 None None] MFA Rules not processed for user `efc23cbdbebc423baed1a2cb6c6cd7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:35:04.771293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5ab9137a-6ca9-44b1-93de-ffe630dbba3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:35:04.771684 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d0ed6c98-aae2-405d-be83-fd047af78811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:35:04.849425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1193/2380] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:35:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:35:04.875358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1188/2381] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:35:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:35:04.880890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed6c98-aae2-405d-be83-fd047af78811 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:35:04.897229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed6c98-aae2-405d-be83-fd047af78811 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:35:04.899477 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fba667-8c17-4723-bc94-a3ecb1e3a0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:35:04.900687 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fba667-8c17-4723-bc94-a3ecb1e3a0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:35:04.900973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fba667-8c17-4723-bc94-a3ecb1e3a0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:35:04.901250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fba667-8c17-4723-bc94-a3ecb1e3a0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:35:04.901954 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fba667-8c17-4723-bc94-a3ecb1e3a0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:35:04.904137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fba667-8c17-4723-bc94-a3ecb1e3a0e5 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:35:05.005045 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1194/2382] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:35:04 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:35:05.009105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9137a-6ca9-44b1-93de-ffe630dbba3c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:35:05.020286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9137a-6ca9-44b1-93de-ffe630dbba3c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:35:05.086998 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4407b9-8df2-44c6-85bb-6763d9e65850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:35:05.088750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4407b9-8df2-44c6-85bb-6763d9e65850 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:35:05.088750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4407b9-8df2-44c6-85bb-6763d9e65850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:35:05.088750 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4407b9-8df2-44c6-85bb-6763d9e65850 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:35:05.089386 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4407b9-8df2-44c6-85bb-6763d9e65850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:35:05.091385 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4407b9-8df2-44c6-85bb-6763d9e65850 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:35:05.169985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1189/2383] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:35:05 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:35:05.175884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fba667-8c17-4723-bc94-a3ecb1e3a0e5 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:35:05.188856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fba667-8c17-4723-bc94-a3ecb1e3a0e5 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:35:05.194420 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47b56a-a370-42f8-b838-2186e93e2a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:35:05.195334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b56a-a370-42f8-b838-2186e93e2a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:35:05.195772 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b56a-a370-42f8-b838-2186e93e2a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:35:05.196200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b56a-a370-42f8-b838-2186e93e2a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:35:05.197123 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47b56a-a370-42f8-b838-2186e93e2a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:35:05.198911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47b56a-a370-42f8-b838-2186e93e2a1e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:35:05.212082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1195/2384] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:35:05.216854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4407b9-8df2-44c6-85bb-6763d9e65850 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:35:05.227589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4407b9-8df2-44c6-85bb-6763d9e65850 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:35:05.233632 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab516bb4-7eaa-4a27-a864-2a1e6d551b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:35:05.234548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab516bb4-7eaa-4a27-a864-2a1e6d551b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:35:05.234836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab516bb4-7eaa-4a27-a864-2a1e6d551b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:35:05.235157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab516bb4-7eaa-4a27-a864-2a1e6d551b8f admin admin] PATH_INFO: `/v3/projects/3beeaeb8a8bc41b08f7d9b6cb0780214/users/25dc88c37a754f02953fb0d8765d2653/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:35:05.251725 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab516bb4-7eaa-4a27-a864-2a1e6d551b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3beeaeb8a8bc41b08f7d9b6cb0780214, user_id=25dc88c37a754f02953fb0d8765d2653, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:35:05.254523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab516bb4-7eaa-4a27-a864-2a1e6d551b8f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:35:05.351426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1190/2385] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:35:05 2022] PUT /identity/v3/projects/3beeaeb8a8bc41b08f7d9b6cb0780214/users/25dc88c37a754f02953fb0d8765d2653/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:35:05.356058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47b56a-a370-42f8-b838-2186e93e2a1e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:35:05.366586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47b56a-a370-42f8-b838-2186e93e2a1e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:35:05.433487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278c8e1-81d0-4023-925a-a61b1f75be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:35:05.434181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278c8e1-81d0-4023-925a-a61b1f75be20 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:35:05.434456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278c8e1-81d0-4023-925a-a61b1f75be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:35:05.434725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278c8e1-81d0-4023-925a-a61b1f75be20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:35:05.435500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278c8e1-81d0-4023-925a-a61b1f75be20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:35:05.437866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278c8e1-81d0-4023-925a-a61b1f75be20 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:35:05.448924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1196/2386] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:35:05.453275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab516bb4-7eaa-4a27-a864-2a1e6d551b8f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:35:05.464028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab516bb4-7eaa-4a27-a864-2a1e6d551b8f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:35:05.468958 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443bad4-73bc-47b6-b506-d99f744f2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:35:05.469854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443bad4-73bc-47b6-b506-d99f744f2c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:35:05.470161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443bad4-73bc-47b6-b506-d99f744f2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:35:05.470442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443bad4-73bc-47b6-b506-d99f744f2c62 admin admin] PATH_INFO: `/v3/projects/3beeaeb8a8bc41b08f7d9b6cb0780214/users/25dc88c37a754f02953fb0d8765d2653/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:35:05.472698 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443bad4-73bc-47b6-b506-d99f744f2c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3beeaeb8a8bc41b08f7d9b6cb0780214, user_id=25dc88c37a754f02953fb0d8765d2653, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:35:05.475471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443bad4-73bc-47b6-b506-d99f744f2c62 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:35:05.493362 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1191/2387] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:35:05 2022] PUT /identity/v3/projects/3beeaeb8a8bc41b08f7d9b6cb0780214/users/25dc88c37a754f02953fb0d8765d2653/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:35:12.834255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec4845-5316-4f58-922b-05ea97fb8087 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:35:12.834823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec4845-5316-4f58-922b-05ea97fb8087 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:35:12.834823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec4845-5316-4f58-922b-05ea97fb8087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:35:12.862765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f9ec4845-5316-4f58-922b-05ea97fb8087 None None] MFA Rules not processed for user `25dc88c37a754f02953fb0d8765d2653`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:35:12.864035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f9ec4845-5316-4f58-922b-05ea97fb8087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:35:12.932623 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1197/2388] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:35:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:35:12.946667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443bad4-73bc-47b6-b506-d99f744f2c62 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:35:12.948615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8443bad4-73bc-47b6-b506-d99f744f2c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:35:13.023833 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443bad4-73bc-47b6-b506-d99f744f2c62 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:35:13.029305 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50940f2-2181-49fd-ae41-5765d5897856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:35:13.029951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50940f2-2181-49fd-ae41-5765d5897856 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:35:13.030234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50940f2-2181-49fd-ae41-5765d5897856 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:35:13.030534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50940f2-2181-49fd-ae41-5765d5897856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:35:13.084932 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50940f2-2181-49fd-ae41-5765d5897856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:35:13.086574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50940f2-2181-49fd-ae41-5765d5897856 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:35:13.095917 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1192/2389] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:35:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:35:40.586049 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c437d1a-3e56-4c44-9c8a-8e126c1cb61e None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:35:40.586601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c437d1a-3e56-4c44-9c8a-8e126c1cb61e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:35:40.586601 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c437d1a-3e56-4c44-9c8a-8e126c1cb61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:35:40.604722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-5c437d1a-3e56-4c44-9c8a-8e126c1cb61e None None] MFA Rules not processed for user `45482c562be6438ebd456ee9512ef3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:35:40.605905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-5c437d1a-3e56-4c44-9c8a-8e126c1cb61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:35:40.613593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1198/2390] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:35:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:35:59.985505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50940f2-2181-49fd-ae41-5765d5897856 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:00.039657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50940f2-2181-49fd-ae41-5765d5897856 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:00.043486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d32df-25ea-431d-9261-e4d6d537769d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:00.044138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d32df-25ea-431d-9261-e4d6d537769d service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:00.044423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d32df-25ea-431d-9261-e4d6d537769d service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:00.044701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d32df-25ea-431d-9261-e4d6d537769d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:00.047171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-914d32df-25ea-431d-9261-e4d6d537769d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:00.106437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d32df-25ea-431d-9261-e4d6d537769d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:00.107923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d32df-25ea-431d-9261-e4d6d537769d service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:00.121305 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1193/2391] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:03.353002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c437d1a-3e56-4c44-9c8a-8e126c1cb61e None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:03.354554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-5c437d1a-3e56-4c44-9c8a-8e126c1cb61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:03.372632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c437d1a-3e56-4c44-9c8a-8e126c1cb61e None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:03.376897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c8c51-0804-4096-a03f-9809d384cb1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:03.377543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c8c51-0804-4096-a03f-9809d384cb1c service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:03.377826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c8c51-0804-4096-a03f-9809d384cb1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:03.378100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c8c51-0804-4096-a03f-9809d384cb1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:03.388725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c8c51-0804-4096-a03f-9809d384cb1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:03.390255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c8c51-0804-4096-a03f-9809d384cb1c service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:03.400629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1199/2392] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:04.508695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d32df-25ea-431d-9261-e4d6d537769d service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:04.510233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-914d32df-25ea-431d-9261-e4d6d537769d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:04.523921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d32df-25ea-431d-9261-e4d6d537769d service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:04.529328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85817727-064b-49e0-a390-ce748faade04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:04.530714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85817727-064b-49e0-a390-ce748faade04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:04.531199 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85817727-064b-49e0-a390-ce748faade04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:04.531473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85817727-064b-49e0-a390-ce748faade04 admin admin] PATH_INFO: `/v3/users/a0294c57ba3f41bc8cf2cac294bb678c` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:04.532766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85817727-064b-49e0-a390-ce748faade04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0294c57ba3f41bc8cf2cac294bb678c)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:04.534749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85817727-064b-49e0-a390-ce748faade04 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:04.728449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-85817727-064b-49e0-a390-ce748faade04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0294c57ba3f41bc8cf2cac294bb678c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:04.742341 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-85817727-064b-49e0-a390-ce748faade04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0294c57ba3f41bc8cf2cac294bb678c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:04.749265 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-85817727-064b-49e0-a390-ce748faade04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0294c57ba3f41bc8cf2cac294bb678c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:04.750009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-85817727-064b-49e0-a390-ce748faade04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0294c57ba3f41bc8cf2cac294bb678c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:04.794065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-85817727-064b-49e0-a390-ce748faade04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0294c57ba3f41bc8cf2cac294bb678c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:04.801437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1194/2393] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:36:04 2022] DELETE /identity/v3/users/a0294c57ba3f41bc8cf2cac294bb678c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:05.058436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c8c51-0804-4096-a03f-9809d384cb1c service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:05.071694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c8c51-0804-4096-a03f-9809d384cb1c service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:05.133626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:05.134496 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:05.134823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:05.135145 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] PATH_INFO: `/v3/projects/27832590c00f47b7b09c343e892f310a` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:05.136407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=27832590c00f47b7b09c343e892f310a)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:05.138356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:05.229211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27832590c00f47b7b09c343e892f310a', 'request_id': 'req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:05.236476 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27832590c00f47b7b09c343e892f310a', 'request_id': 'req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:05.285636 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27832590c00f47b7b09c343e892f310a', 'request_id': 'req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:05.305728 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] The token cache is being invalidate because project 27832590c00f47b7b09c343e892f310a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:36:05.306167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:05.307283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3c27d8c5-0b0c-4670-a084-bc8138b8cb2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:05.315071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1200/2394] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:36:05 2022] DELETE /identity/v3/projects/27832590c00f47b7b09c343e892f310a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:05.316831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fdfe1-4061-4b42-9331-3e71ad5c1778 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:05.317121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fdfe1-4061-4b42-9331-3e71ad5c1778 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:05.317398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fdfe1-4061-4b42-9331-3e71ad5c1778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:05.346443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c68fdfe1-4061-4b42-9331-3e71ad5c1778 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:05.346443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c68fdfe1-4061-4b42-9331-3e71ad5c1778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:05.416054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1195/2395] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:36:05.424304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bd497-da07-4bea-963d-41caaca875da None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:05.424805 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bd497-da07-4bea-963d-41caaca875da None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:05.425405 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bd497-da07-4bea-963d-41caaca875da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:05.445410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-191bd497-da07-4bea-963d-41caaca875da None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:05.447267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-191bd497-da07-4bea-963d-41caaca875da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:05.463474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1201/2396] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:05.468415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fdfe1-4061-4b42-9331-3e71ad5c1778 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:05.478831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fdfe1-4061-4b42-9331-3e71ad5c1778 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:05.484360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f76bc-cf1d-40f1-a93b-99796955ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:05.485469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f76bc-cf1d-40f1-a93b-99796955ffeb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:05.485469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f76bc-cf1d-40f1-a93b-99796955ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:05.485806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f76bc-cf1d-40f1-a93b-99796955ffeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:05.486718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f76bc-cf1d-40f1-a93b-99796955ffeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:36:05.487019 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f76bc-cf1d-40f1-a93b-99796955ffeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:05.488677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f76bc-cf1d-40f1-a93b-99796955ffeb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:05.501262 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1196/2397] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:36:05.505610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bd497-da07-4bea-963d-41caaca875da None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:05.515364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bd497-da07-4bea-963d-41caaca875da None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:05.519985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2f6f-c1be-43d3-89c1-e3288ab7a25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:05.526974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2f6f-c1be-43d3-89c1-e3288ab7a25d admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:05.526974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2f6f-c1be-43d3-89c1-e3288ab7a25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:05.526974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2f6f-c1be-43d3-89c1-e3288ab7a25d admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:05.526974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec2f6f-c1be-43d3-89c1-e3288ab7a25d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:05.526974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec2f6f-c1be-43d3-89c1-e3288ab7a25d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:05.640117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1202/2398] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:36:05 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:05.641581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f76bc-cf1d-40f1-a93b-99796955ffeb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:05.654516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f76bc-cf1d-40f1-a93b-99796955ffeb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:05.721538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a76f1a-4e76-4560-881e-d5425bc35096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:05.722396 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76f1a-4e76-4560-881e-d5425bc35096 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:05.723548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76f1a-4e76-4560-881e-d5425bc35096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:05.723548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76f1a-4e76-4560-881e-d5425bc35096 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:05.723967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a76f1a-4e76-4560-881e-d5425bc35096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:05.726323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a76f1a-4e76-4560-881e-d5425bc35096 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:05.862516 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1197/2399] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:36:05 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:05.862705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2f6f-c1be-43d3-89c1-e3288ab7a25d admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:05.874302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2f6f-c1be-43d3-89c1-e3288ab7a25d admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:05.880398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69d26a-4e75-4233-ae27-4855f984c285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:05.881697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69d26a-4e75-4233-ae27-4855f984c285 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:05.882141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69d26a-4e75-4233-ae27-4855f984c285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:05.882619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69d26a-4e75-4233-ae27-4855f984c285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:05.884023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69d26a-4e75-4233-ae27-4855f984c285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:05.886261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69d26a-4e75-4233-ae27-4855f984c285 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:05.903197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1203/2400] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:05.907281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a76f1a-4e76-4560-881e-d5425bc35096 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:05.923296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a76f1a-4e76-4560-881e-d5425bc35096 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:05.924765 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68227bc8-8e66-4195-883d-0775cce3c762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:05.925613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227bc8-8e66-4195-883d-0775cce3c762 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:05.926057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227bc8-8e66-4195-883d-0775cce3c762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:05.926482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227bc8-8e66-4195-883d-0775cce3c762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:05.927485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68227bc8-8e66-4195-883d-0775cce3c762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:05.929295 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68227bc8-8e66-4195-883d-0775cce3c762 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:05.942523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1198/2401] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:36:05.946583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69d26a-4e75-4233-ae27-4855f984c285 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:05.964633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69d26a-4e75-4233-ae27-4855f984c285 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:05.984499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc2aba-01d6-4930-80ef-700e0ee14384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:05.985820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc2aba-01d6-4930-80ef-700e0ee14384 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:05.986313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc2aba-01d6-4930-80ef-700e0ee14384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:05.986798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc2aba-01d6-4930-80ef-700e0ee14384 admin admin] PATH_INFO: `/v3/projects/d2bb6994f7ba41a6b1357dcada96a806/users/78d4025c721647428b799ca0e159c0c6/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:06.022624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc2aba-01d6-4930-80ef-700e0ee14384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bb6994f7ba41a6b1357dcada96a806, user_id=78d4025c721647428b799ca0e159c0c6, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:06.026005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc2aba-01d6-4930-80ef-700e0ee14384 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:06.126926 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1204/2402] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:05 2022] PUT /identity/v3/projects/d2bb6994f7ba41a6b1357dcada96a806/users/78d4025c721647428b799ca0e159c0c6/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:06.137955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc272de-8f03-4cfb-9e38-51795587d90c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:06.138244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc272de-8f03-4cfb-9e38-51795587d90c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:06.138576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc272de-8f03-4cfb-9e38-51795587d90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:06.167771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3cc272de-8f03-4cfb-9e38-51795587d90c None None] MFA Rules not processed for user `78d4025c721647428b799ca0e159c0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:06.169457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3cc272de-8f03-4cfb-9e38-51795587d90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:06.244151 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1199/2403] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:06.258756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc2aba-01d6-4930-80ef-700e0ee14384 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:06.260904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-bdcc2aba-01d6-4930-80ef-700e0ee14384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:06.351536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc2aba-01d6-4930-80ef-700e0ee14384 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:06.360156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e910b-d160-470e-9fae-00e0f18c2799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:06.361059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e910b-d160-470e-9fae-00e0f18c2799 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:06.361451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e910b-d160-470e-9fae-00e0f18c2799 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:06.361837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e910b-d160-470e-9fae-00e0f18c2799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:06.371485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e910b-d160-470e-9fae-00e0f18c2799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:06.373448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e910b-d160-470e-9fae-00e0f18c2799 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:06.389891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1205/2404] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:08.098222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53b759-8ea4-482d-991e-0fcc15fef6ed None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:08.098705 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53b759-8ea4-482d-991e-0fcc15fef6ed None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:08.101294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53b759-8ea4-482d-991e-0fcc15fef6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:08.117168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-bc53b759-8ea4-482d-991e-0fcc15fef6ed None None] MFA Rules not processed for user `dfc52b61bcf845d1953a5a111abb3666`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:08.118386 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bc53b759-8ea4-482d-991e-0fcc15fef6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:08.171475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1200/2405] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:09.678674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e910b-d160-470e-9fae-00e0f18c2799 service nova] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:09.738940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e910b-d160-470e-9fae-00e0f18c2799 service nova] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:09.743490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:09.744361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:09.744646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:09.744923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] PATH_INFO: `/v3/users/78d4025c721647428b799ca0e159c0c6` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:09.746111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d4025c721647428b799ca0e159c0c6)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:09.748097 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:09.928340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d4025c721647428b799ca0e159c0c6'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:09.940417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d4025c721647428b799ca0e159c0c6'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:09.941114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d4025c721647428b799ca0e159c0c6'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:10.011338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d4025c721647428b799ca0e159c0c6'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:10.019384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d4025c721647428b799ca0e159c0c6'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:10.025557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1206/2406] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:36:09 2022] DELETE /identity/v3/users/78d4025c721647428b799ca0e159c0c6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:10.030195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d520ded-dc70-4b99-8fbd-44269df64bc7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:10.030696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d520ded-dc70-4b99-8fbd-44269df64bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:10.030818 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d520ded-dc70-4b99-8fbd-44269df64bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:10.048645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9d520ded-dc70-4b99-8fbd-44269df64bc7 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:10.051020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9d520ded-dc70-4b99-8fbd-44269df64bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:10.108920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1201/2407] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:10.118581 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:10.123270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:10.177605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdea044-7595-4e02-88c6-9919405b4b16 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:10.181239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245734b1-1749-4953-820f-df2008a2b2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:10.181878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245734b1-1749-4953-820f-df2008a2b2fc service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:10.182150 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245734b1-1749-4953-820f-df2008a2b2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:10.182426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245734b1-1749-4953-820f-df2008a2b2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:10.191361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245734b1-1749-4953-820f-df2008a2b2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:10.192855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245734b1-1749-4953-820f-df2008a2b2fc service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:10.203059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1207/2408] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:10.681327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d520ded-dc70-4b99-8fbd-44269df64bc7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:10.682757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9d520ded-dc70-4b99-8fbd-44269df64bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:10.695110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d520ded-dc70-4b99-8fbd-44269df64bc7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:10.700197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:10.708126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:10.708126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:10.708126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] PATH_INFO: `/v3/projects/d2bb6994f7ba41a6b1357dcada96a806` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:10.708126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bb6994f7ba41a6b1357dcada96a806)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:10.708126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:10.812169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bb6994f7ba41a6b1357dcada96a806', 'request_id': 'req-e3fccf13-7418-4853-977a-8906eff4de48'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:10.817855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bb6994f7ba41a6b1357dcada96a806', 'request_id': 'req-e3fccf13-7418-4853-977a-8906eff4de48'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:10.879590 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bb6994f7ba41a6b1357dcada96a806', 'request_id': 'req-e3fccf13-7418-4853-977a-8906eff4de48'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:10.892003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] The token cache is being invalidate because project d2bb6994f7ba41a6b1357dcada96a806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:36:10.892522 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:10.893247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e3fccf13-7418-4853-977a-8906eff4de48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:10.894920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1202/2409] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:36:10 2022] DELETE /identity/v3/projects/d2bb6994f7ba41a6b1357dcada96a806 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:10.902449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25f783-997c-4e92-a8f7-c8c7ac8aff4c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:10.902978 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25f783-997c-4e92-a8f7-c8c7ac8aff4c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:10.903110 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25f783-997c-4e92-a8f7-c8c7ac8aff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:10.921449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-3a25f783-997c-4e92-a8f7-c8c7ac8aff4c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:10.923694 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3a25f783-997c-4e92-a8f7-c8c7ac8aff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:10.995475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1208/2410] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:11.010727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2f8d-40f7-4fc8-8aaf-c6f0785abe25 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:11.010727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2f8d-40f7-4fc8-8aaf-c6f0785abe25 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:11.010727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2f8d-40f7-4fc8-8aaf-c6f0785abe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:11.022323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c63e2f8d-40f7-4fc8-8aaf-c6f0785abe25 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:11.023771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c63e2f8d-40f7-4fc8-8aaf-c6f0785abe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:11.036360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1203/2411] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:36:11.040417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25f783-997c-4e92-a8f7-c8c7ac8aff4c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:11.053588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25f783-997c-4e92-a8f7-c8c7ac8aff4c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:11.062137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586ccbc-2563-40ea-9c49-1937cd4a7427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:11.063623 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586ccbc-2563-40ea-9c49-1937cd4a7427 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:11.064726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586ccbc-2563-40ea-9c49-1937cd4a7427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:11.065550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586ccbc-2563-40ea-9c49-1937cd4a7427 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:11.066893 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586ccbc-2563-40ea-9c49-1937cd4a7427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:36:11.067530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586ccbc-2563-40ea-9c49-1937cd4a7427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:11.069615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586ccbc-2563-40ea-9c49-1937cd4a7427 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:11.084661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1209/2412] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:36:11.089138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e2f8d-40f7-4fc8-8aaf-c6f0785abe25 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:11.099734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e2f8d-40f7-4fc8-8aaf-c6f0785abe25 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:11.104844 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1f3b5-3ea4-48a7-98c5-bb1cccab1d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:11.105493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f3b5-3ea4-48a7-98c5-bb1cccab1d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:11.105776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f3b5-3ea4-48a7-98c5-bb1cccab1d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:11.106052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f3b5-3ea4-48a7-98c5-bb1cccab1d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:11.106739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1f3b5-3ea4-48a7-98c5-bb1cccab1d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:11.108831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1f3b5-3ea4-48a7-98c5-bb1cccab1d73 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:11.187264 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1204/2413] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:36:11 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:11.191600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586ccbc-2563-40ea-9c49-1937cd4a7427 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:11.203074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586ccbc-2563-40ea-9c49-1937cd4a7427 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:11.261392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff691f-d87c-4f60-b54a-e2782ef6afb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:11.262061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff691f-d87c-4f60-b54a-e2782ef6afb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:11.262339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff691f-d87c-4f60-b54a-e2782ef6afb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:11.262617 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff691f-d87c-4f60-b54a-e2782ef6afb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:11.263337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff691f-d87c-4f60-b54a-e2782ef6afb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:11.265922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff691f-d87c-4f60-b54a-e2782ef6afb8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:11.335053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1210/2414] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:36:11 2022] POST /identity/v3/users => generated 302 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:11.336515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1f3b5-3ea4-48a7-98c5-bb1cccab1d73 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:11.346726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1f3b5-3ea4-48a7-98c5-bb1cccab1d73 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:11.352280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd5e2e-572d-4492-b707-9fea6a2735b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:11.352971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd5e2e-572d-4492-b707-9fea6a2735b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:11.353255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd5e2e-572d-4492-b707-9fea6a2735b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:11.353531 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd5e2e-572d-4492-b707-9fea6a2735b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:11.354254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd5e2e-572d-4492-b707-9fea6a2735b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:11.356159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd5e2e-572d-4492-b707-9fea6a2735b0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:11.366941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1205/2415] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:11.371356 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff691f-d87c-4f60-b54a-e2782ef6afb8 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:11.382076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff691f-d87c-4f60-b54a-e2782ef6afb8 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:11.386779 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12dd99-918e-4346-a8b9-fbf2a56db6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:11.387471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12dd99-918e-4346-a8b9-fbf2a56db6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:11.387760 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12dd99-918e-4346-a8b9-fbf2a56db6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:11.388041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12dd99-918e-4346-a8b9-fbf2a56db6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:11.388776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12dd99-918e-4346-a8b9-fbf2a56db6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:11.391066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12dd99-918e-4346-a8b9-fbf2a56db6f7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:11.404763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1211/2416] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:11.407253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd5e2e-572d-4492-b707-9fea6a2735b0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:11.418746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd5e2e-572d-4492-b707-9fea6a2735b0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:11.424107 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04e638-b523-47b2-839c-d799d70606e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:11.424978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e638-b523-47b2-839c-d799d70606e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:11.425260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e638-b523-47b2-839c-d799d70606e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:11.425552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e638-b523-47b2-839c-d799d70606e0 admin admin] PATH_INFO: `/v3/projects/6976e6aa4b764a85b303b819ffcb82d6/users/ad1855960dfa4e8ea5f404b56b804629/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:11.439953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04e638-b523-47b2-839c-d799d70606e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6976e6aa4b764a85b303b819ffcb82d6, user_id=ad1855960dfa4e8ea5f404b56b804629, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:11.442720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04e638-b523-47b2-839c-d799d70606e0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:11.503366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1206/2417] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:11 2022] PUT /identity/v3/projects/6976e6aa4b764a85b303b819ffcb82d6/users/ad1855960dfa4e8ea5f404b56b804629/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:11.515849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2fa50-0468-46e1-882f-225f50f01f25 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:11.521708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2fa50-0468-46e1-882f-225f50f01f25 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:11.521708 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2fa50-0468-46e1-882f-225f50f01f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:11.544325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-2bc2fa50-0468-46e1-882f-225f50f01f25 None None] MFA Rules not processed for user `ad1855960dfa4e8ea5f404b56b804629`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:11.546211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2bc2fa50-0468-46e1-882f-225f50f01f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:11.612157 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1212/2418] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:11.616881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04e638-b523-47b2-839c-d799d70606e0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:11.686789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04e638-b523-47b2-839c-d799d70606e0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:11.691972 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d030a3a-a4b6-45ca-b6b3-ae7376746332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:11.693356 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d030a3a-a4b6-45ca-b6b3-ae7376746332 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:11.693584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d030a3a-a4b6-45ca-b6b3-ae7376746332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:11.693867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d030a3a-a4b6-45ca-b6b3-ae7376746332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:11.694583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d030a3a-a4b6-45ca-b6b3-ae7376746332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:11.696582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d030a3a-a4b6-45ca-b6b3-ae7376746332 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:11.798787 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1207/2419] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:36:11 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:11.803804 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2fa50-0468-46e1-882f-225f50f01f25 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:11.817408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2fa50-0468-46e1-882f-225f50f01f25 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:11.879070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9602ea1-3d56-4267-9249-a733e46de9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:11.879955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9602ea1-3d56-4267-9249-a733e46de9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:11.880333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9602ea1-3d56-4267-9249-a733e46de9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:11.880705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9602ea1-3d56-4267-9249-a733e46de9d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:11.881477 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9602ea1-3d56-4267-9249-a733e46de9d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:11.883618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9602ea1-3d56-4267-9249-a733e46de9d2 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:12.022902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1213/2420] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:36:11 2022] POST /identity/v3/users => generated 309 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:12.027642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d030a3a-a4b6-45ca-b6b3-ae7376746332 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:12.037675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d030a3a-a4b6-45ca-b6b3-ae7376746332 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:12.042345 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5f8db-5202-443c-836b-70e63fd292fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:12.043054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f8db-5202-443c-836b-70e63fd292fa admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:12.043367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f8db-5202-443c-836b-70e63fd292fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:12.043668 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f8db-5202-443c-836b-70e63fd292fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:12.044508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5f8db-5202-443c-836b-70e63fd292fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:12.046360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5f8db-5202-443c-836b-70e63fd292fa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:12.057848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1208/2421] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:12.062476 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9602ea1-3d56-4267-9249-a733e46de9d2 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:12.072783 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9602ea1-3d56-4267-9249-a733e46de9d2 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:12.078186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d131df9-743c-4bad-96a6-d9841bb15426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:12.079289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d131df9-743c-4bad-96a6-d9841bb15426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:12.079398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d131df9-743c-4bad-96a6-d9841bb15426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:12.079645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d131df9-743c-4bad-96a6-d9841bb15426 admin admin] PATH_INFO: `/v3/projects/da80395f444c44b19e0413aa80277f90/users/09dba0889df74d30882d7ba93bcf7194/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:12.095595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d131df9-743c-4bad-96a6-d9841bb15426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da80395f444c44b19e0413aa80277f90, user_id=09dba0889df74d30882d7ba93bcf7194, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:12.098690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d131df9-743c-4bad-96a6-d9841bb15426 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:12.190210 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1214/2422] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:12 2022] PUT /identity/v3/projects/da80395f444c44b19e0413aa80277f90/users/09dba0889df74d30882d7ba93bcf7194/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:12.194229 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5f8db-5202-443c-836b-70e63fd292fa admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:12.209665 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5f8db-5202-443c-836b-70e63fd292fa admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:12.268411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f90e-3471-47da-9de8-59daa233a194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:12.269111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f90e-3471-47da-9de8-59daa233a194 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:12.269392 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f90e-3471-47da-9de8-59daa233a194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:12.269666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f90e-3471-47da-9de8-59daa233a194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:12.270384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8f90e-3471-47da-9de8-59daa233a194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:12.272025 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8f90e-3471-47da-9de8-59daa233a194 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:12.282665 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1209/2423] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:12.286735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d131df9-743c-4bad-96a6-d9841bb15426 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:12.298258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d131df9-743c-4bad-96a6-d9841bb15426 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:12.303575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220847-2428-4d3e-a456-e9c1090fc6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:12.304617 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220847-2428-4d3e-a456-e9c1090fc6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:12.304901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220847-2428-4d3e-a456-e9c1090fc6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:12.305184 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220847-2428-4d3e-a456-e9c1090fc6ed admin admin] PATH_INFO: `/v3/projects/da80395f444c44b19e0413aa80277f90/users/09dba0889df74d30882d7ba93bcf7194/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:12.307446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da220847-2428-4d3e-a456-e9c1090fc6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=da80395f444c44b19e0413aa80277f90, user_id=09dba0889df74d30882d7ba93bcf7194, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:12.310189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da220847-2428-4d3e-a456-e9c1090fc6ed admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:12.332179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1215/2424] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:12 2022] PUT /identity/v3/projects/da80395f444c44b19e0413aa80277f90/users/09dba0889df74d30882d7ba93bcf7194/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:12.333583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af2d3-8717-44aa-bbb8-96048e8ddfa9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:12.333879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af2d3-8717-44aa-bbb8-96048e8ddfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:12.334155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af2d3-8717-44aa-bbb8-96048e8ddfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:12.370357 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-df6af2d3-8717-44aa-bbb8-96048e8ddfa9 None None] MFA Rules not processed for user `09dba0889df74d30882d7ba93bcf7194`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:12.371856 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-df6af2d3-8717-44aa-bbb8-96048e8ddfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:12.456588 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1210/2425] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:12 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:36:12.471886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220847-2428-4d3e-a456-e9c1090fc6ed admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:12.473810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-da220847-2428-4d3e-a456-e9c1090fc6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:12.533046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220847-2428-4d3e-a456-e9c1090fc6ed admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:12.536726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea8497-737a-47f0-8e5e-5cdfbefa28f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:12.537365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea8497-737a-47f0-8e5e-5cdfbefa28f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:12.537647 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea8497-737a-47f0-8e5e-5cdfbefa28f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:12.537920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea8497-737a-47f0-8e5e-5cdfbefa28f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:12.547188 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea8497-737a-47f0-8e5e-5cdfbefa28f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:12.548629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea8497-737a-47f0-8e5e-5cdfbefa28f1 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:12.558016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1216/2426] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:12 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:36:12.742182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6af2d3-8717-44aa-bbb8-96048e8ddfa9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:12.844070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6af2d3-8717-44aa-bbb8-96048e8ddfa9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:12.848714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:12.849812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:12.850277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:12.852284 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] PATH_INFO: `/v3/users/ad1855960dfa4e8ea5f404b56b804629` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:12.853850 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1855960dfa4e8ea5f404b56b804629)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:12.856046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:13.019735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1855960dfa4e8ea5f404b56b804629'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:13.031504 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1855960dfa4e8ea5f404b56b804629'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:13.038471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1855960dfa4e8ea5f404b56b804629'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:13.039302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1855960dfa4e8ea5f404b56b804629'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:13.091084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1855960dfa4e8ea5f404b56b804629'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:13.098841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1211/2427] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:36:12 2022] DELETE /identity/v3/users/ad1855960dfa4e8ea5f404b56b804629 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:13.102530 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c73a6-17f5-42c1-b031-97499364af01 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:13.103030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c73a6-17f5-42c1-b031-97499364af01 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:13.103165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c73a6-17f5-42c1-b031-97499364af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:13.122162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a01c73a6-17f5-42c1-b031-97499364af01 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:13.123415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a01c73a6-17f5-42c1-b031-97499364af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:13.185350 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1217/2428] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:13.196486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:13.197946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:13.254821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4e48d-4fd3-4708-9b23-416ca22221ba admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:13.258536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aa737-641b-4677-a66d-f24e69c3c956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:13.259209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aa737-641b-4677-a66d-f24e69c3c956 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:13.259494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aa737-641b-4677-a66d-f24e69c3c956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:13.259770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aa737-641b-4677-a66d-f24e69c3c956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:13.269473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7aa737-641b-4677-a66d-f24e69c3c956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:13.270926 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7aa737-641b-4677-a66d-f24e69c3c956 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:13.281182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1212/2429] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:13.645579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c73a6-17f5-42c1-b031-97499364af01 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:13.647038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a01c73a6-17f5-42c1-b031-97499364af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:13.662112 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c73a6-17f5-42c1-b031-97499364af01 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:13.668227 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:13.669316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:13.669676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:13.669961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] PATH_INFO: `/v3/projects/6976e6aa4b764a85b303b819ffcb82d6` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:13.671888 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6976e6aa4b764a85b303b819ffcb82d6)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:13.676499 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:13.772704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6976e6aa4b764a85b303b819ffcb82d6', 'request_id': 'req-30d66d19-9574-4ea6-938a-ed12ee254a34'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:13.778963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6976e6aa4b764a85b303b819ffcb82d6', 'request_id': 'req-30d66d19-9574-4ea6-938a-ed12ee254a34'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:13.896792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6976e6aa4b764a85b303b819ffcb82d6', 'request_id': 'req-30d66d19-9574-4ea6-938a-ed12ee254a34'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:13.908321 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] The token cache is being invalidate because project 6976e6aa4b764a85b303b819ffcb82d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:36:13.908605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:13.909226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:13.910763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1218/2430] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:36:13 2022] DELETE /identity/v3/projects/6976e6aa4b764a85b303b819ffcb82d6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:13.914767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aa737-641b-4677-a66d-f24e69c3c956 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:13.924862 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aa737-641b-4677-a66d-f24e69c3c956 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:13.981043 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be7870-4871-417b-9294-b24f5286907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:13.981920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7870-4871-417b-9294-b24f5286907d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:13.982201 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7870-4871-417b-9294-b24f5286907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:13.982475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7870-4871-417b-9294-b24f5286907d admin admin] PATH_INFO: `/v3/users/09dba0889df74d30882d7ba93bcf7194` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:13.984390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be7870-4871-417b-9294-b24f5286907d admin admin] RBAC: Authorizing `identity:delete_user(user_id=09dba0889df74d30882d7ba93bcf7194)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:13.986379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be7870-4871-417b-9294-b24f5286907d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:14.194898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-23be7870-4871-417b-9294-b24f5286907d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09dba0889df74d30882d7ba93bcf7194'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:14.206494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-23be7870-4871-417b-9294-b24f5286907d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09dba0889df74d30882d7ba93bcf7194'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:14.213121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-23be7870-4871-417b-9294-b24f5286907d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09dba0889df74d30882d7ba93bcf7194'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:14.213795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-23be7870-4871-417b-9294-b24f5286907d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09dba0889df74d30882d7ba93bcf7194'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:14.261787 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-23be7870-4871-417b-9294-b24f5286907d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09dba0889df74d30882d7ba93bcf7194'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:14.267920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1213/2431] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:36:13 2022] DELETE /identity/v3/users/09dba0889df74d30882d7ba93bcf7194 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:14.648465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:14.650087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:14.662915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d66d19-9574-4ea6-938a-ed12ee254a34 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:14.721088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:14.721955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:14.722242 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:14.722523 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] PATH_INFO: `/v3/projects/da80395f444c44b19e0413aa80277f90` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:14.723738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da80395f444c44b19e0413aa80277f90)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:14.731270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:14.804473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da80395f444c44b19e0413aa80277f90', 'request_id': 'req-24e62a14-9538-40aa-a767-8524b03da270'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:14.809753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da80395f444c44b19e0413aa80277f90', 'request_id': 'req-24e62a14-9538-40aa-a767-8524b03da270'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:14.856222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da80395f444c44b19e0413aa80277f90', 'request_id': 'req-24e62a14-9538-40aa-a767-8524b03da270'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:14.867668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] The token cache is being invalidate because project da80395f444c44b19e0413aa80277f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:36:14.867948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:14.868551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-24e62a14-9538-40aa-a767-8524b03da270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:14.870104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1219/2432] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:36:14 2022] DELETE /identity/v3/projects/da80395f444c44b19e0413aa80277f90 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:14.875626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2503f3-395a-4a5b-addc-84291133abf1 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:14.875915 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2503f3-395a-4a5b-addc-84291133abf1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:14.876195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2503f3-395a-4a5b-addc-84291133abf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:14.893176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0c2503f3-395a-4a5b-addc-84291133abf1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:14.894398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0c2503f3-395a-4a5b-addc-84291133abf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:14.950886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1214/2433] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:36:14.958687 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fe6d6-8a89-4916-9ce6-e247bbd6b069 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:14.958974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fe6d6-8a89-4916-9ce6-e247bbd6b069 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:14.959295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fe6d6-8a89-4916-9ce6-e247bbd6b069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:14.978331 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-9b9fe6d6-8a89-4916-9ce6-e247bbd6b069 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:14.979578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-9b9fe6d6-8a89-4916-9ce6-e247bbd6b069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:14.988112 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1220/2434] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:14.992335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2503f3-395a-4a5b-addc-84291133abf1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:15.001899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2503f3-395a-4a5b-addc-84291133abf1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:15.007324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42152f-1d2e-4084-8672-84d6e3dbe234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:15.007324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42152f-1d2e-4084-8672-84d6e3dbe234 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:15.007539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42152f-1d2e-4084-8672-84d6e3dbe234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:15.007717 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42152f-1d2e-4084-8672-84d6e3dbe234 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:15.008439 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42152f-1d2e-4084-8672-84d6e3dbe234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:36:15.008748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42152f-1d2e-4084-8672-84d6e3dbe234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:15.010374 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42152f-1d2e-4084-8672-84d6e3dbe234 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:15.021798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1215/2435] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:36:15.026227 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fe6d6-8a89-4916-9ce6-e247bbd6b069 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:15.036019 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fe6d6-8a89-4916-9ce6-e247bbd6b069 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:15.041721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c518bd-2175-4774-a4fe-b72258816834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:15.041721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c518bd-2175-4774-a4fe-b72258816834 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:15.041721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c518bd-2175-4774-a4fe-b72258816834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:15.041721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c518bd-2175-4774-a4fe-b72258816834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:15.042430 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c518bd-2175-4774-a4fe-b72258816834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:15.044408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c518bd-2175-4774-a4fe-b72258816834 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:15.133268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1221/2436] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:36:15 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:15.137192 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42152f-1d2e-4084-8672-84d6e3dbe234 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:15.147244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42152f-1d2e-4084-8672-84d6e3dbe234 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:15.203271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dd707-274e-4174-bd7b-391abed40ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:15.203942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dd707-274e-4174-bd7b-391abed40ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:15.204207 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dd707-274e-4174-bd7b-391abed40ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:15.204477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dd707-274e-4174-bd7b-391abed40ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:15.205188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dd707-274e-4174-bd7b-391abed40ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:15.207167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dd707-274e-4174-bd7b-391abed40ff7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:15.286329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1216/2437] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:36:15 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:15.290523 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c518bd-2175-4774-a4fe-b72258816834 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:15.300755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c518bd-2175-4774-a4fe-b72258816834 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:15.306297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f01c1-cf6d-4c1f-a5fe-b74df5a1dc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:15.306297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f01c1-cf6d-4c1f-a5fe-b74df5a1dc6e admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:15.306520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f01c1-cf6d-4c1f-a5fe-b74df5a1dc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:15.306821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f01c1-cf6d-4c1f-a5fe-b74df5a1dc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:15.307576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f01c1-cf6d-4c1f-a5fe-b74df5a1dc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:15.309175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f01c1-cf6d-4c1f-a5fe-b74df5a1dc6e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:15.319550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1222/2438] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:15.323289 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dd707-274e-4174-bd7b-391abed40ff7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:15.333438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dd707-274e-4174-bd7b-391abed40ff7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:15.338038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe3215-de91-40d1-b6e7-42720d66ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:15.338682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe3215-de91-40d1-b6e7-42720d66ba73 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:15.338963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe3215-de91-40d1-b6e7-42720d66ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:15.339286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe3215-de91-40d1-b6e7-42720d66ba73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:15.340006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe3215-de91-40d1-b6e7-42720d66ba73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:15.341663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe3215-de91-40d1-b6e7-42720d66ba73 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:15.352278 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1217/2439] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:15.356283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f01c1-cf6d-4c1f-a5fe-b74df5a1dc6e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:15.366362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f01c1-cf6d-4c1f-a5fe-b74df5a1dc6e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:15.371033 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4743b-1872-4e31-9a0a-a84445e4eeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:15.371941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4743b-1872-4e31-9a0a-a84445e4eeea admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:15.372228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4743b-1872-4e31-9a0a-a84445e4eeea admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:15.372505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4743b-1872-4e31-9a0a-a84445e4eeea admin admin] PATH_INFO: `/v3/projects/47606882f07445daac70bd0f28e41e35/users/33943761ce9043c3bfac7e745dd81f53/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:15.387412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4743b-1872-4e31-9a0a-a84445e4eeea admin admin] RBAC: Authorizing `identity:create_grant(project_id=47606882f07445daac70bd0f28e41e35, user_id=33943761ce9043c3bfac7e745dd81f53, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:15.390599 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4743b-1872-4e31-9a0a-a84445e4eeea admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:15.496271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1223/2440] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:15 2022] PUT /identity/v3/projects/47606882f07445daac70bd0f28e41e35/users/33943761ce9043c3bfac7e745dd81f53/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:36:15.508184 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce60640-779c-48fa-b331-b3bdab3bd1b8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:15.511280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce60640-779c-48fa-b331-b3bdab3bd1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:15.511280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce60640-779c-48fa-b331-b3bdab3bd1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:15.534372 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8ce60640-779c-48fa-b331-b3bdab3bd1b8 None None] MFA Rules not processed for user `33943761ce9043c3bfac7e745dd81f53`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:15.535677 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8ce60640-779c-48fa-b331-b3bdab3bd1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:15.597531 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1218/2441] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:15.602348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4743b-1872-4e31-9a0a-a84445e4eeea admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:15.660695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4743b-1872-4e31-9a0a-a84445e4eeea admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:15.665416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf9ed8-65be-48dc-8c2c-134bd6cd8a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:15.666059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf9ed8-65be-48dc-8c2c-134bd6cd8a2a admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:15.666340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf9ed8-65be-48dc-8c2c-134bd6cd8a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:15.666613 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf9ed8-65be-48dc-8c2c-134bd6cd8a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:15.667329 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf9ed8-65be-48dc-8c2c-134bd6cd8a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:15.669264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf9ed8-65be-48dc-8c2c-134bd6cd8a2a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:15.812583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1224/2442] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:36:15 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:36:15.816620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce60640-779c-48fa-b331-b3bdab3bd1b8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:15.827566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce60640-779c-48fa-b331-b3bdab3bd1b8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:15.888702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb566bf-29c1-4d8f-86ce-612aade255f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:15.890008 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb566bf-29c1-4d8f-86ce-612aade255f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:15.890283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb566bf-29c1-4d8f-86ce-612aade255f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:15.890552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb566bf-29c1-4d8f-86ce-612aade255f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:15.891281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb566bf-29c1-4d8f-86ce-612aade255f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:15.893274 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb566bf-29c1-4d8f-86ce-612aade255f2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:15.991624 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1219/2443] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:36:15 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:36:15.993205 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf9ed8-65be-48dc-8c2c-134bd6cd8a2a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:16.004559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf9ed8-65be-48dc-8c2c-134bd6cd8a2a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:16.009355 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e715643-a5a5-49c6-a5e6-987dc3ef2528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:16.010010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e715643-a5a5-49c6-a5e6-987dc3ef2528 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:16.010292 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e715643-a5a5-49c6-a5e6-987dc3ef2528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:16.010565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e715643-a5a5-49c6-a5e6-987dc3ef2528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:16.011320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e715643-a5a5-49c6-a5e6-987dc3ef2528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:16.012924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e715643-a5a5-49c6-a5e6-987dc3ef2528 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:16.023934 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1225/2444] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:16.028072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb566bf-29c1-4d8f-86ce-612aade255f2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:16.038205 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb566bf-29c1-4d8f-86ce-612aade255f2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:16.042940 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61af2-d7e6-422e-b215-8c8037dcb9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:16.044655 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61af2-d7e6-422e-b215-8c8037dcb9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:16.044967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61af2-d7e6-422e-b215-8c8037dcb9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:16.045248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61af2-d7e6-422e-b215-8c8037dcb9e4 admin admin] PATH_INFO: `/v3/projects/f768e0dbd91344ebb129fba63c74105d/users/86b39d67dda447f396c6ebdc21266e46/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:16.062088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c61af2-d7e6-422e-b215-8c8037dcb9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f768e0dbd91344ebb129fba63c74105d, user_id=86b39d67dda447f396c6ebdc21266e46, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:16.065226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c61af2-d7e6-422e-b215-8c8037dcb9e4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:16.177639 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1220/2445] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:16 2022] PUT /identity/v3/projects/f768e0dbd91344ebb129fba63c74105d/users/86b39d67dda447f396c6ebdc21266e46/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:16.181620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e715643-a5a5-49c6-a5e6-987dc3ef2528 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:16.192269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e715643-a5a5-49c6-a5e6-987dc3ef2528 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:16.248165 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b1e02-0aaf-4ed4-89f2-e4afd4502f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:16.248950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b1e02-0aaf-4ed4-89f2-e4afd4502f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:16.249229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b1e02-0aaf-4ed4-89f2-e4afd4502f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:16.249507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b1e02-0aaf-4ed4-89f2-e4afd4502f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:16.250237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b1e02-0aaf-4ed4-89f2-e4afd4502f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:16.251889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b1e02-0aaf-4ed4-89f2-e4afd4502f75 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:16.265117 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1226/2446] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:16.266872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61af2-d7e6-422e-b215-8c8037dcb9e4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:16.277164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61af2-d7e6-422e-b215-8c8037dcb9e4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:16.282530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61d168-49cd-4e4f-b9a9-add3c0c6719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:16.283475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61d168-49cd-4e4f-b9a9-add3c0c6719a admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:16.283759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61d168-49cd-4e4f-b9a9-add3c0c6719a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:16.284036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61d168-49cd-4e4f-b9a9-add3c0c6719a admin admin] PATH_INFO: `/v3/projects/f768e0dbd91344ebb129fba63c74105d/users/86b39d67dda447f396c6ebdc21266e46/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:16.286076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61d168-49cd-4e4f-b9a9-add3c0c6719a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f768e0dbd91344ebb129fba63c74105d, user_id=86b39d67dda447f396c6ebdc21266e46, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:16.288847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61d168-49cd-4e4f-b9a9-add3c0c6719a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:16.299726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1221/2447] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:16 2022] PUT /identity/v3/projects/f768e0dbd91344ebb129fba63c74105d/users/86b39d67dda447f396c6ebdc21266e46/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:16.309886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f384a0-846f-4888-afb0-e35121c77623 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:16.310187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f384a0-846f-4888-afb0-e35121c77623 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:16.310470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f384a0-846f-4888-afb0-e35121c77623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:16.338108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-05f384a0-846f-4888-afb0-e35121c77623 None None] MFA Rules not processed for user `86b39d67dda447f396c6ebdc21266e46`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:16.339360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-05f384a0-846f-4888-afb0-e35121c77623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:16.408699 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1227/2448] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:16.419902 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61d168-49cd-4e4f-b9a9-add3c0c6719a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:16.421663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ca61d168-49cd-4e4f-b9a9-add3c0c6719a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:16.476879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61d168-49cd-4e4f-b9a9-add3c0c6719a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:16.480905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33153164-4ea8-4c67-9467-8b57aecd9632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:16.481544 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153164-4ea8-4c67-9467-8b57aecd9632 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:16.481828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153164-4ea8-4c67-9467-8b57aecd9632 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:16.482101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153164-4ea8-4c67-9467-8b57aecd9632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:16.491209 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33153164-4ea8-4c67-9467-8b57aecd9632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:16.492675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33153164-4ea8-4c67-9467-8b57aecd9632 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:16.503166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1222/2449] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:16.531797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f384a0-846f-4888-afb0-e35121c77623 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:16.594317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f384a0-846f-4888-afb0-e35121c77623 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:16.599061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:16.600008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:16.600293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:16.600598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] PATH_INFO: `/v3/users/33943761ce9043c3bfac7e745dd81f53` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:16.601864 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33943761ce9043c3bfac7e745dd81f53)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:16.604170 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:16.824485 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33943761ce9043c3bfac7e745dd81f53'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:16.836543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33943761ce9043c3bfac7e745dd81f53'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:16.837632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33943761ce9043c3bfac7e745dd81f53'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:16.902144 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33943761ce9043c3bfac7e745dd81f53'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:16.909742 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33943761ce9043c3bfac7e745dd81f53'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:16.916691 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1228/2450] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:36:16 2022] DELETE /identity/v3/users/33943761ce9043c3bfac7e745dd81f53 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:16.921833 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9d2c-5310-458a-a596-fe73dce7954f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:16.922449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9d2c-5310-458a-a596-fe73dce7954f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:16.922709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9d2c-5310-458a-a596-fe73dce7954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:16.941571 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e5ba9d2c-5310-458a-a596-fe73dce7954f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:16.942797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e5ba9d2c-5310-458a-a596-fe73dce7954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:17.005989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1223/2451] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:17.015809 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:17.017373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:17.075058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ccb53-00aa-40ac-83f7-254af350fb53 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:17.079272 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48faa9a-2370-46ea-bd82-f4057a9dceee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:17.079917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48faa9a-2370-46ea-bd82-f4057a9dceee service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:17.080204 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48faa9a-2370-46ea-bd82-f4057a9dceee service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:17.080483 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48faa9a-2370-46ea-bd82-f4057a9dceee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:17.089219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48faa9a-2370-46ea-bd82-f4057a9dceee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:17.090674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48faa9a-2370-46ea-bd82-f4057a9dceee service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:17.100673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1229/2452] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:17.470185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9d2c-5310-458a-a596-fe73dce7954f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:17.471675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e5ba9d2c-5310-458a-a596-fe73dce7954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:17.484167 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9d2c-5310-458a-a596-fe73dce7954f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:17.490299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:17.491485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:17.491991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:17.492448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] PATH_INFO: `/v3/projects/47606882f07445daac70bd0f28e41e35` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:17.493834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47606882f07445daac70bd0f28e41e35)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:17.496028 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:17.595766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47606882f07445daac70bd0f28e41e35', 'request_id': 'req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:17.601347 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47606882f07445daac70bd0f28e41e35', 'request_id': 'req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:17.644877 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47606882f07445daac70bd0f28e41e35', 'request_id': 'req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:17.656710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] The token cache is being invalidate because project 47606882f07445daac70bd0f28e41e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:36:17.657003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:17.657636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:17.659253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1224/2453] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:36:17 2022] DELETE /identity/v3/projects/47606882f07445daac70bd0f28e41e35 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:17.663352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48faa9a-2370-46ea-bd82-f4057a9dceee service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:17.673002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48faa9a-2370-46ea-bd82-f4057a9dceee service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:17.727593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52a6eb-9e86-486d-9104-87eeea02e3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:17.728460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a6eb-9e86-486d-9104-87eeea02e3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:17.728742 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a6eb-9e86-486d-9104-87eeea02e3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:17.729017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a6eb-9e86-486d-9104-87eeea02e3b5 admin admin] PATH_INFO: `/v3/users/86b39d67dda447f396c6ebdc21266e46` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:17.730198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52a6eb-9e86-486d-9104-87eeea02e3b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b39d67dda447f396c6ebdc21266e46)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:17.732189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52a6eb-9e86-486d-9104-87eeea02e3b5 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:17.916031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3a52a6eb-9e86-486d-9104-87eeea02e3b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b39d67dda447f396c6ebdc21266e46'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:17.928198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3a52a6eb-9e86-486d-9104-87eeea02e3b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b39d67dda447f396c6ebdc21266e46'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:17.928891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3a52a6eb-9e86-486d-9104-87eeea02e3b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b39d67dda447f396c6ebdc21266e46'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:18.039270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3a52a6eb-9e86-486d-9104-87eeea02e3b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b39d67dda447f396c6ebdc21266e46'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:18.047286 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-3a52a6eb-9e86-486d-9104-87eeea02e3b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b39d67dda447f396c6ebdc21266e46'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:18.053237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1230/2454] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:36:17 2022] DELETE /identity/v3/users/86b39d67dda447f396c6ebdc21266e46 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:18.471062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:18.478708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:18.496408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf75b04-3673-4d9a-9bd6-76aeb33d166d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:18.556908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:18.557808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:18.558113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:18.558372 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] PATH_INFO: `/v3/projects/f768e0dbd91344ebb129fba63c74105d` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:18.559939 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f768e0dbd91344ebb129fba63c74105d)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:18.561892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:18.670868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f768e0dbd91344ebb129fba63c74105d', 'request_id': 'req-5db072fa-34ec-4931-a538-690bc28894a4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:18.677119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f768e0dbd91344ebb129fba63c74105d', 'request_id': 'req-5db072fa-34ec-4931-a538-690bc28894a4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:18.771119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f768e0dbd91344ebb129fba63c74105d', 'request_id': 'req-5db072fa-34ec-4931-a538-690bc28894a4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:18.784379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] The token cache is being invalidate because project f768e0dbd91344ebb129fba63c74105d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:36:18.784655 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:18.785435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5db072fa-34ec-4931-a538-690bc28894a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:18.787494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1225/2455] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:36:18 2022] DELETE /identity/v3/projects/f768e0dbd91344ebb129fba63c74105d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:18.793532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ee25-05db-4a40-8429-f9c21279f641 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:18.793941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ee25-05db-4a40-8429-f9c21279f641 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:18.794466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ee25-05db-4a40-8429-f9c21279f641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:18.814839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-2443ee25-05db-4a40-8429-f9c21279f641 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:18.816130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2443ee25-05db-4a40-8429-f9c21279f641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:18.880211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1231/2456] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:36:18.887691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a05404-f8c0-4bcc-9531-36bda26eb278 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:18.887984 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a05404-f8c0-4bcc-9531-36bda26eb278 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:18.888270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a05404-f8c0-4bcc-9531-36bda26eb278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:18.907274 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-20a05404-f8c0-4bcc-9531-36bda26eb278 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:18.908494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-20a05404-f8c0-4bcc-9531-36bda26eb278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:18.916852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1226/2457] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:18.921166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443ee25-05db-4a40-8429-f9c21279f641 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:18.931639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443ee25-05db-4a40-8429-f9c21279f641 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:18.936302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c04c64-3c65-4b2e-9d52-fd8bf3f0a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:18.937003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c04c64-3c65-4b2e-9d52-fd8bf3f0a21c admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:18.937784 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c04c64-3c65-4b2e-9d52-fd8bf3f0a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:18.938057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c04c64-3c65-4b2e-9d52-fd8bf3f0a21c admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:18.938777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c04c64-3c65-4b2e-9d52-fd8bf3f0a21c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:36:18.939079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c04c64-3c65-4b2e-9d52-fd8bf3f0a21c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:18.940709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c04c64-3c65-4b2e-9d52-fd8bf3f0a21c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:18.952009 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1232/2458] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:36:18.957051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a05404-f8c0-4bcc-9531-36bda26eb278 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:18.966704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a05404-f8c0-4bcc-9531-36bda26eb278 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:18.971360 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a467788-a5c7-45a1-9f2f-419edf453eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:18.972006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a467788-a5c7-45a1-9f2f-419edf453eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:18.972287 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a467788-a5c7-45a1-9f2f-419edf453eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:18.972563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a467788-a5c7-45a1-9f2f-419edf453eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:18.973259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a467788-a5c7-45a1-9f2f-419edf453eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:18.975247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a467788-a5c7-45a1-9f2f-419edf453eeb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:19.047558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1227/2459] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:36:18 2022] POST /identity/v3/projects => generated 391 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:19.051742 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c04c64-3c65-4b2e-9d52-fd8bf3f0a21c admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:19.063454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c04c64-3c65-4b2e-9d52-fd8bf3f0a21c admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:19.117886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2543051-0f61-4abd-98e7-baeacbea7544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:19.118587 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2543051-0f61-4abd-98e7-baeacbea7544 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:19.118876 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2543051-0f61-4abd-98e7-baeacbea7544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:19.119186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2543051-0f61-4abd-98e7-baeacbea7544 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:19.119880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2543051-0f61-4abd-98e7-baeacbea7544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:19.121843 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2543051-0f61-4abd-98e7-baeacbea7544 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:19.216142 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1233/2460] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:36:19 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:19.220281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a467788-a5c7-45a1-9f2f-419edf453eeb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:19.230552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a467788-a5c7-45a1-9f2f-419edf453eeb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:19.236004 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16ba9d-37ff-4c94-8f87-f5312035dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:19.236668 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16ba9d-37ff-4c94-8f87-f5312035dcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:19.236955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16ba9d-37ff-4c94-8f87-f5312035dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:19.237233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16ba9d-37ff-4c94-8f87-f5312035dcd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:19.237990 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16ba9d-37ff-4c94-8f87-f5312035dcd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:19.240120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16ba9d-37ff-4c94-8f87-f5312035dcd6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:19.252116 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1228/2461] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:36:19.256149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2543051-0f61-4abd-98e7-baeacbea7544 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:19.267094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2543051-0f61-4abd-98e7-baeacbea7544 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:19.271927 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ec22e-8ad3-45de-9353-d881f4cc0f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:19.272615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ec22e-8ad3-45de-9353-d881f4cc0f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:19.272901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ec22e-8ad3-45de-9353-d881f4cc0f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:19.273180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ec22e-8ad3-45de-9353-d881f4cc0f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:19.273941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ec22e-8ad3-45de-9353-d881f4cc0f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:19.275588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ec22e-8ad3-45de-9353-d881f4cc0f0e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:19.286595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1234/2462] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:36:19.290911 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16ba9d-37ff-4c94-8f87-f5312035dcd6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:19.300709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16ba9d-37ff-4c94-8f87-f5312035dcd6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:19.305370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5269c92-cb7e-451a-a522-adb79097718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:19.306262 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5269c92-cb7e-451a-a522-adb79097718c admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:19.306543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5269c92-cb7e-451a-a522-adb79097718c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:19.306822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5269c92-cb7e-451a-a522-adb79097718c admin admin] PATH_INFO: `/v3/projects/e558ec7d72874b968a241ee804cc279e/users/1f3086eb2bff41f48601a54613416867/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:19.321420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5269c92-cb7e-451a-a522-adb79097718c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e558ec7d72874b968a241ee804cc279e, user_id=1f3086eb2bff41f48601a54613416867, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:19.324165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5269c92-cb7e-451a-a522-adb79097718c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:19.388496 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1229/2463] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:19 2022] PUT /identity/v3/projects/e558ec7d72874b968a241ee804cc279e/users/1f3086eb2bff41f48601a54613416867/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:19.400228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11968ff8-bce6-4bc1-92ca-c28a2f201872 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:19.400629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11968ff8-bce6-4bc1-92ca-c28a2f201872 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:19.400911 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11968ff8-bce6-4bc1-92ca-c28a2f201872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:19.426840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-11968ff8-bce6-4bc1-92ca-c28a2f201872 None None] MFA Rules not processed for user `1f3086eb2bff41f48601a54613416867`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:19.428085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-11968ff8-bce6-4bc1-92ca-c28a2f201872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:19.489421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1235/2464] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:19.493868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5269c92-cb7e-451a-a522-adb79097718c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:19.553994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5269c92-cb7e-451a-a522-adb79097718c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:19.558679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a1c15-c661-4bb2-bbe2-b9b168816fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:19.559377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a1c15-c661-4bb2-bbe2-b9b168816fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:19.559674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a1c15-c661-4bb2-bbe2-b9b168816fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:19.559951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a1c15-c661-4bb2-bbe2-b9b168816fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:19.560681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a1c15-c661-4bb2-bbe2-b9b168816fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:19.563222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a1c15-c661-4bb2-bbe2-b9b168816fc0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:19.652257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1230/2465] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:36:19 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:36:19.656237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11968ff8-bce6-4bc1-92ca-c28a2f201872 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:19.667176 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11968ff8-bce6-4bc1-92ca-c28a2f201872 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:19.721288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc6b4d-6728-4955-b5d5-ff7fb5bea84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:19.721956 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc6b4d-6728-4955-b5d5-ff7fb5bea84c admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:19.722238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc6b4d-6728-4955-b5d5-ff7fb5bea84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:19.722515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc6b4d-6728-4955-b5d5-ff7fb5bea84c admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:19.723257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc6b4d-6728-4955-b5d5-ff7fb5bea84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:19.725324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc6b4d-6728-4955-b5d5-ff7fb5bea84c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:19.800221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1236/2466] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:36:19 2022] POST /identity/v3/users => generated 302 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:36:19.806123 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a1c15-c661-4bb2-bbe2-b9b168816fc0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:19.815182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a1c15-c661-4bb2-bbe2-b9b168816fc0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:19.820115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf1f58-262b-4e53-b7f8-e235da9f0b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:19.820806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf1f58-262b-4e53-b7f8-e235da9f0b31 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:19.821161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf1f58-262b-4e53-b7f8-e235da9f0b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:19.821442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf1f58-262b-4e53-b7f8-e235da9f0b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:19.822176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf1f58-262b-4e53-b7f8-e235da9f0b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:19.823832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf1f58-262b-4e53-b7f8-e235da9f0b31 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:19.835149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1231/2467] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:19.844007 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc6b4d-6728-4955-b5d5-ff7fb5bea84c admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:19.854723 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc6b4d-6728-4955-b5d5-ff7fb5bea84c admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:19.860232 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8edf3-699c-4570-85f3-abd68bade079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:19.861135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8edf3-699c-4570-85f3-abd68bade079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:19.861422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8edf3-699c-4570-85f3-abd68bade079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:19.861700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8edf3-699c-4570-85f3-abd68bade079 admin admin] PATH_INFO: `/v3/projects/2ab65684455444c7884da0f1656384b2/users/686b86be2ed94149ae394ed6a73e68b3/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:19.885720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8edf3-699c-4570-85f3-abd68bade079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab65684455444c7884da0f1656384b2, user_id=686b86be2ed94149ae394ed6a73e68b3, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:19.889047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8edf3-699c-4570-85f3-abd68bade079 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:19.977419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1237/2468] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:19 2022] PUT /identity/v3/projects/2ab65684455444c7884da0f1656384b2/users/686b86be2ed94149ae394ed6a73e68b3/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:19.981305 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf1f58-262b-4e53-b7f8-e235da9f0b31 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:19.991631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf1f58-262b-4e53-b7f8-e235da9f0b31 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:20.044691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039674c3-c004-4e66-a677-89e079b1f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:20.045277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039674c3-c004-4e66-a677-89e079b1f502 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:20.045554 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039674c3-c004-4e66-a677-89e079b1f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:20.045831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039674c3-c004-4e66-a677-89e079b1f502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:20.046541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039674c3-c004-4e66-a677-89e079b1f502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:20.048676 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039674c3-c004-4e66-a677-89e079b1f502 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:20.057937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1232/2469] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:20.062243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8edf3-699c-4570-85f3-abd68bade079 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:20.073185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8edf3-699c-4570-85f3-abd68bade079 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:20.077955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9ddc-7fb3-442d-b5be-3ac6f7d9f782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:20.078838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9ddc-7fb3-442d-b5be-3ac6f7d9f782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:20.079140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9ddc-7fb3-442d-b5be-3ac6f7d9f782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:20.079439 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9ddc-7fb3-442d-b5be-3ac6f7d9f782 admin admin] PATH_INFO: `/v3/projects/2ab65684455444c7884da0f1656384b2/users/686b86be2ed94149ae394ed6a73e68b3/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:20.081448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce9ddc-7fb3-442d-b5be-3ac6f7d9f782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab65684455444c7884da0f1656384b2, user_id=686b86be2ed94149ae394ed6a73e68b3, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:20.084213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce9ddc-7fb3-442d-b5be-3ac6f7d9f782 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:20.094787 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1238/2470] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:20 2022] PUT /identity/v3/projects/2ab65684455444c7884da0f1656384b2/users/686b86be2ed94149ae394ed6a73e68b3/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:20.105043 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a1aa-30c7-4cdf-a46e-dfb9bf8f039d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:20.105333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a1aa-30c7-4cdf-a46e-dfb9bf8f039d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:20.105611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a1aa-30c7-4cdf-a46e-dfb9bf8f039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:20.131925 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9621a1aa-30c7-4cdf-a46e-dfb9bf8f039d None None] MFA Rules not processed for user `686b86be2ed94149ae394ed6a73e68b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:20.133117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9621a1aa-30c7-4cdf-a46e-dfb9bf8f039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:20.196911 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1233/2471] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:20.208021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9ddc-7fb3-442d-b5be-3ac6f7d9f782 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:20.209689 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b5ce9ddc-7fb3-442d-b5be-3ac6f7d9f782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:20.264452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9ddc-7fb3-442d-b5be-3ac6f7d9f782 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:20.268641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab9582-c605-453d-b1b8-ac298a5c37d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:20.269273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab9582-c605-453d-b1b8-ac298a5c37d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:20.269557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab9582-c605-453d-b1b8-ac298a5c37d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:20.269836 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab9582-c605-453d-b1b8-ac298a5c37d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:20.278618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab9582-c605-453d-b1b8-ac298a5c37d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:20.280091 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab9582-c605-453d-b1b8-ac298a5c37d7 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:20.289331 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1239/2472] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:20.334631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621a1aa-30c7-4cdf-a46e-dfb9bf8f039d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:20.342848 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9621a1aa-30c7-4cdf-a46e-dfb9bf8f039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:20.347655 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621a1aa-30c7-4cdf-a46e-dfb9bf8f039d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:20.351422 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca28cc-66f0-4f0f-a803-95bf1cd6aba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:20.352379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca28cc-66f0-4f0f-a803-95bf1cd6aba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:20.352662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca28cc-66f0-4f0f-a803-95bf1cd6aba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:20.352937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca28cc-66f0-4f0f-a803-95bf1cd6aba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:20.407702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca28cc-66f0-4f0f-a803-95bf1cd6aba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:20.409160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca28cc-66f0-4f0f-a803-95bf1cd6aba6 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:20.418416 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1234/2473] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:25.128906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab9582-c605-453d-b1b8-ac298a5c37d7 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:25.188563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab9582-c605-453d-b1b8-ac298a5c37d7 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:25.193635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:25.194493 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:25.194776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:25.195050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] PATH_INFO: `/v3/users/1f3086eb2bff41f48601a54613416867` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:25.196256 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3086eb2bff41f48601a54613416867)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:25.198198 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:25.349261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3086eb2bff41f48601a54613416867'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:25.360978 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3086eb2bff41f48601a54613416867'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:25.362194 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3086eb2bff41f48601a54613416867'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:25.410854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3086eb2bff41f48601a54613416867'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:25.417735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3086eb2bff41f48601a54613416867'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:25.424129 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1240/2474] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:36:25 2022] DELETE /identity/v3/users/1f3086eb2bff41f48601a54613416867 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:25.428680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b789-c732-47ef-abb0-1bc72af53013 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:25.429141 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b789-c732-47ef-abb0-1bc72af53013 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:25.429251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716b789-c732-47ef-abb0-1bc72af53013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:25.445650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0716b789-c732-47ef-abb0-1bc72af53013 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:25.446845 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0716b789-c732-47ef-abb0-1bc72af53013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:25.502833 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1235/2475] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:25.512672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:25.514103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:25.570715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef017-352a-45eb-85aa-a0ce6e4cc990 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:25.574413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbab945-0ed4-456d-a43c-656d515e0845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:25.575052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbab945-0ed4-456d-a43c-656d515e0845 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:25.575371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbab945-0ed4-456d-a43c-656d515e0845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:25.575652 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbab945-0ed4-456d-a43c-656d515e0845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:25.585340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbab945-0ed4-456d-a43c-656d515e0845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:25.586798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbab945-0ed4-456d-a43c-656d515e0845 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:25.596275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1241/2476] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:26.012595 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716b789-c732-47ef-abb0-1bc72af53013 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:26.014102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0716b789-c732-47ef-abb0-1bc72af53013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:26.028158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716b789-c732-47ef-abb0-1bc72af53013 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:26.033680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:26.034546 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:26.034827 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:26.035100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] PATH_INFO: `/v3/projects/e558ec7d72874b968a241ee804cc279e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:26.036351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e558ec7d72874b968a241ee804cc279e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:26.038303 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:26.134320 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e558ec7d72874b968a241ee804cc279e', 'request_id': 'req-e8fe39e5-3e5b-4496-81f6-f478f24a3988'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:26.139633 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e558ec7d72874b968a241ee804cc279e', 'request_id': 'req-e8fe39e5-3e5b-4496-81f6-f478f24a3988'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:26.217048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e558ec7d72874b968a241ee804cc279e', 'request_id': 'req-e8fe39e5-3e5b-4496-81f6-f478f24a3988'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:26.229709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] The token cache is being invalidate because project e558ec7d72874b968a241ee804cc279e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:36:26.229997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:26.230685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:26.232280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1236/2477] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:36:26 2022] DELETE /identity/v3/projects/e558ec7d72874b968a241ee804cc279e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:26.236431 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbab945-0ed4-456d-a43c-656d515e0845 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:26.248464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbab945-0ed4-456d-a43c-656d515e0845 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:26.304168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21eb67-7919-4856-8632-fb4404160216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:26.305052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21eb67-7919-4856-8632-fb4404160216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:26.305337 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21eb67-7919-4856-8632-fb4404160216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:26.305614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21eb67-7919-4856-8632-fb4404160216 admin admin] PATH_INFO: `/v3/users/686b86be2ed94149ae394ed6a73e68b3` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:26.306809 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21eb67-7919-4856-8632-fb4404160216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=686b86be2ed94149ae394ed6a73e68b3)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:26.308801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21eb67-7919-4856-8632-fb4404160216 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:26.464522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ae21eb67-7919-4856-8632-fb4404160216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686b86be2ed94149ae394ed6a73e68b3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:26.479582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ae21eb67-7919-4856-8632-fb4404160216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686b86be2ed94149ae394ed6a73e68b3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:26.480214 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ae21eb67-7919-4856-8632-fb4404160216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686b86be2ed94149ae394ed6a73e68b3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:26.550124 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ae21eb67-7919-4856-8632-fb4404160216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686b86be2ed94149ae394ed6a73e68b3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:26.557660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-ae21eb67-7919-4856-8632-fb4404160216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686b86be2ed94149ae394ed6a73e68b3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:26.564441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1242/2478] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:36:26 2022] DELETE /identity/v3/users/686b86be2ed94149ae394ed6a73e68b3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:27.012378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:27.014088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:27.033773 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe39e5-3e5b-4496-81f6-f478f24a3988 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:27.093431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:27.094290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:27.094569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:27.094887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] PATH_INFO: `/v3/projects/2ab65684455444c7884da0f1656384b2` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:27.096150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab65684455444c7884da0f1656384b2)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:27.098228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:27.215943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab65684455444c7884da0f1656384b2', 'request_id': 'req-a878bfb6-781a-4207-80ac-effc44c3c457'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:27.221948 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab65684455444c7884da0f1656384b2', 'request_id': 'req-a878bfb6-781a-4207-80ac-effc44c3c457'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:27.296236 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab65684455444c7884da0f1656384b2', 'request_id': 'req-a878bfb6-781a-4207-80ac-effc44c3c457'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:27.307832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] The token cache is being invalidate because project 2ab65684455444c7884da0f1656384b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:36:27.308121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:27.309527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a878bfb6-781a-4207-80ac-effc44c3c457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:27.311078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1237/2479] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:36:27 2022] DELETE /identity/v3/projects/2ab65684455444c7884da0f1656384b2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:27.316159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ad278-c36f-4e6e-89ce-34a6248c228b None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:27.316648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ad278-c36f-4e6e-89ce-34a6248c228b None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:27.316745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ad278-c36f-4e6e-89ce-34a6248c228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:27.336342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-699ad278-c36f-4e6e-89ce-34a6248c228b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:27.337568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-699ad278-c36f-4e6e-89ce-34a6248c228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:27.394344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1243/2480] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:36:27.402125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87020-217f-43d1-828b-8b40bcbe1e51 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:27.402412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87020-217f-43d1-828b-8b40bcbe1e51 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:27.402691 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87020-217f-43d1-828b-8b40bcbe1e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:27.421014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9fa87020-217f-43d1-828b-8b40bcbe1e51 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:27.422215 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9fa87020-217f-43d1-828b-8b40bcbe1e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:27.430012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1238/2481] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:27.433940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ad278-c36f-4e6e-89ce-34a6248c228b None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:27.443482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ad278-c36f-4e6e-89ce-34a6248c228b None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:27.448003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fa69e-cd67-4d7d-89f7-ba63e2193ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:27.448655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fa69e-cd67-4d7d-89f7-ba63e2193ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:27.448941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fa69e-cd67-4d7d-89f7-ba63e2193ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:27.449221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fa69e-cd67-4d7d-89f7-ba63e2193ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:27.449948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fa69e-cd67-4d7d-89f7-ba63e2193ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:36:27.450257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fa69e-cd67-4d7d-89f7-ba63e2193ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:27.451913 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fa69e-cd67-4d7d-89f7-ba63e2193ef3 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:27.463741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1244/2482] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:36:27.468092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa87020-217f-43d1-828b-8b40bcbe1e51 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:27.477995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa87020-217f-43d1-828b-8b40bcbe1e51 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:27.482559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3662ed-b42c-4d44-b477-b347b5eb422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:27.483272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3662ed-b42c-4d44-b477-b347b5eb422a admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:27.483553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3662ed-b42c-4d44-b477-b347b5eb422a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:27.483871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3662ed-b42c-4d44-b477-b347b5eb422a admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:27.484563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3662ed-b42c-4d44-b477-b347b5eb422a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:27.486480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3662ed-b42c-4d44-b477-b347b5eb422a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:27.595158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1239/2483] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:36:27 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:36:27.599358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fa69e-cd67-4d7d-89f7-ba63e2193ef3 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:27.609387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fa69e-cd67-4d7d-89f7-ba63e2193ef3 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:27.662506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc5d8a-9e4f-4fdd-b4fb-3f55d2b2710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:27.663189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5d8a-9e4f-4fdd-b4fb-3f55d2b2710b admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:27.663472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5d8a-9e4f-4fdd-b4fb-3f55d2b2710b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:27.663747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5d8a-9e4f-4fdd-b4fb-3f55d2b2710b admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:27.664433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc5d8a-9e4f-4fdd-b4fb-3f55d2b2710b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:27.666360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc5d8a-9e4f-4fdd-b4fb-3f55d2b2710b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:27.753968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1245/2484] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:36:27 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:27.758243 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3662ed-b42c-4d44-b477-b347b5eb422a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:27.769211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3662ed-b42c-4d44-b477-b347b5eb422a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:27.773785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64247c87-a2d1-4cea-b5eb-5214deaa1a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:27.776333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64247c87-a2d1-4cea-b5eb-5214deaa1a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:27.776333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64247c87-a2d1-4cea-b5eb-5214deaa1a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:27.776333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64247c87-a2d1-4cea-b5eb-5214deaa1a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:27.776333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64247c87-a2d1-4cea-b5eb-5214deaa1a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:27.777365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64247c87-a2d1-4cea-b5eb-5214deaa1a88 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:27.787710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1240/2485] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:27.791607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc5d8a-9e4f-4fdd-b4fb-3f55d2b2710b admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:27.801352 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc5d8a-9e4f-4fdd-b4fb-3f55d2b2710b admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:27.805980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e389d77-2d30-4cb9-878a-abe436322478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:27.806609 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389d77-2d30-4cb9-878a-abe436322478 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:27.806891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389d77-2d30-4cb9-878a-abe436322478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:27.807200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389d77-2d30-4cb9-878a-abe436322478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:27.807923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e389d77-2d30-4cb9-878a-abe436322478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:27.809508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e389d77-2d30-4cb9-878a-abe436322478 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:27.819549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1246/2486] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:27.823473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64247c87-a2d1-4cea-b5eb-5214deaa1a88 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:27.833826 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64247c87-a2d1-4cea-b5eb-5214deaa1a88 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:27.838541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17561158-c155-4a79-8a7a-d339b184dd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:27.839444 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561158-c155-4a79-8a7a-d339b184dd71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:27.839729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561158-c155-4a79-8a7a-d339b184dd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:27.840680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561158-c155-4a79-8a7a-d339b184dd71 admin admin] PATH_INFO: `/v3/projects/76bcf0a4a10c416a8bcd081e8ec7d1a5/users/7cf07027b9934f1db9d5a116297ae019/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:27.854718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17561158-c155-4a79-8a7a-d339b184dd71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bcf0a4a10c416a8bcd081e8ec7d1a5, user_id=7cf07027b9934f1db9d5a116297ae019, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:27.857489 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17561158-c155-4a79-8a7a-d339b184dd71 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:27.908085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1241/2487] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:27 2022] PUT /identity/v3/projects/76bcf0a4a10c416a8bcd081e8ec7d1a5/users/7cf07027b9934f1db9d5a116297ae019/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:27.924343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a15cf-b174-49ec-b918-2c97e53b3684 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:27.924664 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a15cf-b174-49ec-b918-2c97e53b3684 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:27.924945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a15cf-b174-49ec-b918-2c97e53b3684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:27.951133 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-ec1a15cf-b174-49ec-b918-2c97e53b3684 None None] MFA Rules not processed for user `7cf07027b9934f1db9d5a116297ae019`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:27.952406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ec1a15cf-b174-49ec-b918-2c97e53b3684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:28.018241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1247/2488] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:28.022670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17561158-c155-4a79-8a7a-d339b184dd71 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:28.081779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17561158-c155-4a79-8a7a-d339b184dd71 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:28.086325 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eccb7-d241-4e0d-b29f-e0e085ad0b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:28.086963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eccb7-d241-4e0d-b29f-e0e085ad0b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:28.087266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eccb7-d241-4e0d-b29f-e0e085ad0b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:28.087538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eccb7-d241-4e0d-b29f-e0e085ad0b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:28.088224 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eccb7-d241-4e0d-b29f-e0e085ad0b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:28.090149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eccb7-d241-4e0d-b29f-e0e085ad0b39 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:28.223630 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1242/2489] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:36:28 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:28.227671 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a15cf-b174-49ec-b918-2c97e53b3684 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:28.239061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a15cf-b174-49ec-b918-2c97e53b3684 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:28.309458 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbfd61-2141-429c-99e7-4593cf8a1787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:28.310715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbfd61-2141-429c-99e7-4593cf8a1787 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:28.311014 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbfd61-2141-429c-99e7-4593cf8a1787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:28.311324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbfd61-2141-429c-99e7-4593cf8a1787 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:28.312032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbfd61-2141-429c-99e7-4593cf8a1787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:28.313976 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbfd61-2141-429c-99e7-4593cf8a1787 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:28.388182 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1248/2490] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:36:28 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:28.392094 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eccb7-d241-4e0d-b29f-e0e085ad0b39 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:28.403020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eccb7-d241-4e0d-b29f-e0e085ad0b39 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:28.408612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e913f8-8342-4ed5-8f83-461ff3a74c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:28.409265 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e913f8-8342-4ed5-8f83-461ff3a74c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:28.409542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e913f8-8342-4ed5-8f83-461ff3a74c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:28.409816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e913f8-8342-4ed5-8f83-461ff3a74c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:28.410581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e913f8-8342-4ed5-8f83-461ff3a74c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:28.412168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e913f8-8342-4ed5-8f83-461ff3a74c57 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:28.422853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1243/2491] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:28.426970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbfd61-2141-429c-99e7-4593cf8a1787 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:28.437058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbfd61-2141-429c-99e7-4593cf8a1787 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:28.442183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539364eb-d9ab-487b-af98-37f993f62ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:28.443055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539364eb-d9ab-487b-af98-37f993f62ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:28.443420 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539364eb-d9ab-487b-af98-37f993f62ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:28.443715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539364eb-d9ab-487b-af98-37f993f62ccd admin admin] PATH_INFO: `/v3/projects/5367ac4af84b45f6b10e31974a350cae/users/a41b5c080a6c455586b6c9ce1ab9b47b/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:28.458858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539364eb-d9ab-487b-af98-37f993f62ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5367ac4af84b45f6b10e31974a350cae, user_id=a41b5c080a6c455586b6c9ce1ab9b47b, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:28.461474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539364eb-d9ab-487b-af98-37f993f62ccd admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:28.541719 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1249/2492] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:28 2022] PUT /identity/v3/projects/5367ac4af84b45f6b10e31974a350cae/users/a41b5c080a6c455586b6c9ce1ab9b47b/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:28.545654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e913f8-8342-4ed5-8f83-461ff3a74c57 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:28.555667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e913f8-8342-4ed5-8f83-461ff3a74c57 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:28.611937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fa2d7-596c-4e76-aa28-1fe59604a313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:28.612619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fa2d7-596c-4e76-aa28-1fe59604a313 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:28.612905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fa2d7-596c-4e76-aa28-1fe59604a313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:28.613183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fa2d7-596c-4e76-aa28-1fe59604a313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:28.613916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fa2d7-596c-4e76-aa28-1fe59604a313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:28.615601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fa2d7-596c-4e76-aa28-1fe59604a313 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:28.625547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1244/2493] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:28.630307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539364eb-d9ab-487b-af98-37f993f62ccd admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:28.640661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539364eb-d9ab-487b-af98-37f993f62ccd admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:28.646429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea146c6c-34ca-4594-a82e-2d2670b8ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:28.647346 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea146c6c-34ca-4594-a82e-2d2670b8ca56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:28.647637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea146c6c-34ca-4594-a82e-2d2670b8ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:28.647919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea146c6c-34ca-4594-a82e-2d2670b8ca56 admin admin] PATH_INFO: `/v3/projects/5367ac4af84b45f6b10e31974a350cae/users/a41b5c080a6c455586b6c9ce1ab9b47b/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:28.650232 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea146c6c-34ca-4594-a82e-2d2670b8ca56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5367ac4af84b45f6b10e31974a350cae, user_id=a41b5c080a6c455586b6c9ce1ab9b47b, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:28.653266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea146c6c-34ca-4594-a82e-2d2670b8ca56 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:28.663068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1250/2494] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:28 2022] PUT /identity/v3/projects/5367ac4af84b45f6b10e31974a350cae/users/a41b5c080a6c455586b6c9ce1ab9b47b/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:28.673124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092162e-09e6-4944-86e8-f5b79e657f6f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:28.673938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092162e-09e6-4944-86e8-f5b79e657f6f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:28.674225 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092162e-09e6-4944-86e8-f5b79e657f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:28.700291 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a092162e-09e6-4944-86e8-f5b79e657f6f None None] MFA Rules not processed for user `a41b5c080a6c455586b6c9ce1ab9b47b`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:28.701502 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a092162e-09e6-4944-86e8-f5b79e657f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:28.767030 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1245/2495] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:28.777430 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea146c6c-34ca-4594-a82e-2d2670b8ca56 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:28.779085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ea146c6c-34ca-4594-a82e-2d2670b8ca56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:28.834309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea146c6c-34ca-4594-a82e-2d2670b8ca56 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:28.837959 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131b32d-8e1f-4d10-b321-500c8b4afbf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:28.838595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131b32d-8e1f-4d10-b321-500c8b4afbf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:28.838884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131b32d-8e1f-4d10-b321-500c8b4afbf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:28.839250 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131b32d-8e1f-4d10-b321-500c8b4afbf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:28.892899 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131b32d-8e1f-4d10-b321-500c8b4afbf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:28.894364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131b32d-8e1f-4d10-b321-500c8b4afbf0 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:28.903275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1251/2496] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:30.149083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa094e8-f653-4664-a182-442745347a91 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:30.149589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa094e8-f653-4664-a182-442745347a91 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:30.149688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa094e8-f653-4664-a182-442745347a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:30.167935 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-baa094e8-f653-4664-a182-442745347a91 None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:30.169125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-baa094e8-f653-4664-a182-442745347a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:30.221764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1246/2497] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:36:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:30.368916 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131b32d-8e1f-4d10-b321-500c8b4afbf0 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:30.371093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a131b32d-8e1f-4d10-b321-500c8b4afbf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:30.437933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131b32d-8e1f-4d10-b321-500c8b4afbf0 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:30.443028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1630bc1-3515-4627-9b25-9f1c82108661 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:30.443705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630bc1-3515-4627-9b25-9f1c82108661 service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:30.443993 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630bc1-3515-4627-9b25-9f1c82108661 service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:30.444269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630bc1-3515-4627-9b25-9f1c82108661 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:30.452317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1630bc1-3515-4627-9b25-9f1c82108661 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:30.453923 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1630bc1-3515-4627-9b25-9f1c82108661 service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:30.462457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1252/2498] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:36:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:36:36.173012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa094e8-f653-4664-a182-442745347a91 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:36.174594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-baa094e8-f653-4664-a182-442745347a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:36.194025 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa094e8-f653-4664-a182-442745347a91 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:36.198100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0fd81-73b8-40de-be6e-ddd0d2618647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:36.198778 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0fd81-73b8-40de-be6e-ddd0d2618647 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:36.199083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0fd81-73b8-40de-be6e-ddd0d2618647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:36.199407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0fd81-73b8-40de-be6e-ddd0d2618647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:36.210739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0fd81-73b8-40de-be6e-ddd0d2618647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:36.212772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0fd81-73b8-40de-be6e-ddd0d2618647 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:36.241016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1247/2499] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:40.152768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1630bc1-3515-4627-9b25-9f1c82108661 service swift] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:40.154291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e1630bc1-3515-4627-9b25-9f1c82108661 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:40.230763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1630bc1-3515-4627-9b25-9f1c82108661 service swift] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:40.234596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8a4cb-cfee-4014-90e3-ff2c2980d3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:40.235326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8a4cb-cfee-4014-90e3-ff2c2980d3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:40.235607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8a4cb-cfee-4014-90e3-ff2c2980d3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:40.236057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8a4cb-cfee-4014-90e3-ff2c2980d3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:40.237914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b7c8a4cb-cfee-4014-90e3-ff2c2980d3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:40.322462 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8a4cb-cfee-4014-90e3-ff2c2980d3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:40.324205 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8a4cb-cfee-4014-90e3-ff2c2980d3e9 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:40.343467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1253/2500] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:41.551640 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0fd81-73b8-40de-be6e-ddd0d2618647 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:41.554106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dde0fd81-73b8-40de-be6e-ddd0d2618647 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:41.569551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0fd81-73b8-40de-be6e-ddd0d2618647 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:41.574301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26e3e3-161d-427d-9fe7-ea3f81544da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:41.574955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26e3e3-161d-427d-9fe7-ea3f81544da1 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:41.575269 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26e3e3-161d-427d-9fe7-ea3f81544da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:41.575777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26e3e3-161d-427d-9fe7-ea3f81544da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:41.577373 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2b26e3e3-161d-427d-9fe7-ea3f81544da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:41.596904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26e3e3-161d-427d-9fe7-ea3f81544da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:41.600469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26e3e3-161d-427d-9fe7-ea3f81544da1 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:41.623381 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1248/2501] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:43.774918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8a4cb-cfee-4014-90e3-ff2c2980d3e9 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:43.837314 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8a4cb-cfee-4014-90e3-ff2c2980d3e9 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:43.841775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:43.842637 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:43.842921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:43.843231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] PATH_INFO: `/v3/users/7cf07027b9934f1db9d5a116297ae019` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:43.844406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf07027b9934f1db9d5a116297ae019)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:43.846333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:43.989901 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf07027b9934f1db9d5a116297ae019'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:44.001805 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf07027b9934f1db9d5a116297ae019'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:44.002516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf07027b9934f1db9d5a116297ae019'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:44.056169 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf07027b9934f1db9d5a116297ae019'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:44.063795 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf07027b9934f1db9d5a116297ae019'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:44.070654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1254/2502] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:36:43 2022] DELETE /identity/v3/users/7cf07027b9934f1db9d5a116297ae019 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:44.075429 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba31c78-7c76-494a-9448-152dfdfcb67b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:44.076014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba31c78-7c76-494a-9448-152dfdfcb67b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:44.076014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba31c78-7c76-494a-9448-152dfdfcb67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:44.100879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-fba31c78-7c76-494a-9448-152dfdfcb67b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:44.103431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fba31c78-7c76-494a-9448-152dfdfcb67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:44.179154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1249/2503] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:44.188834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:44.190270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:44.245772 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7a4c0-6489-43dc-9c6c-b8e8afcf0f5f admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:44.249357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aade8-3c68-4917-9d73-2750eaf173a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:44.249989 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aade8-3c68-4917-9d73-2750eaf173a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:44.250288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aade8-3c68-4917-9d73-2750eaf173a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:44.250563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aade8-3c68-4917-9d73-2750eaf173a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:44.259756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aade8-3c68-4917-9d73-2750eaf173a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:44.261191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aade8-3c68-4917-9d73-2750eaf173a4 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:44.270886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1255/2504] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:44.667072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba31c78-7c76-494a-9448-152dfdfcb67b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:44.667072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fba31c78-7c76-494a-9448-152dfdfcb67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:44.677203 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba31c78-7c76-494a-9448-152dfdfcb67b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:44.681821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:44.682678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:44.683009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:44.683500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] PATH_INFO: `/v3/projects/76bcf0a4a10c416a8bcd081e8ec7d1a5` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:44.684722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=76bcf0a4a10c416a8bcd081e8ec7d1a5)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:44.686644 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:44.780807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76bcf0a4a10c416a8bcd081e8ec7d1a5', 'request_id': 'req-f6dc16da-6aa2-41fc-b555-da3f9f096fac'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:44.786485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76bcf0a4a10c416a8bcd081e8ec7d1a5', 'request_id': 'req-f6dc16da-6aa2-41fc-b555-da3f9f096fac'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:44.832947 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76bcf0a4a10c416a8bcd081e8ec7d1a5', 'request_id': 'req-f6dc16da-6aa2-41fc-b555-da3f9f096fac'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:44.844255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] The token cache is being invalidate because project 76bcf0a4a10c416a8bcd081e8ec7d1a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:36:44.846431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:44.846431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:44.846865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1250/2505] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:36:44 2022] DELETE /identity/v3/projects/76bcf0a4a10c416a8bcd081e8ec7d1a5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:44.851340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aade8-3c68-4917-9d73-2750eaf173a4 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:44.861284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aade8-3c68-4917-9d73-2750eaf173a4 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:44.918629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b87dd-f9d9-492e-89c5-3bf88673badc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:44.919456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b87dd-f9d9-492e-89c5-3bf88673badc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:44.919744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b87dd-f9d9-492e-89c5-3bf88673badc admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:44.920020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b87dd-f9d9-492e-89c5-3bf88673badc admin admin] PATH_INFO: `/v3/users/a41b5c080a6c455586b6c9ce1ab9b47b` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:44.921254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b87dd-f9d9-492e-89c5-3bf88673badc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41b5c080a6c455586b6c9ce1ab9b47b)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:44.925359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b87dd-f9d9-492e-89c5-3bf88673badc admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:45.053262 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c76b87dd-f9d9-492e-89c5-3bf88673badc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41b5c080a6c455586b6c9ce1ab9b47b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:45.065110 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c76b87dd-f9d9-492e-89c5-3bf88673badc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41b5c080a6c455586b6c9ce1ab9b47b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:45.065850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c76b87dd-f9d9-492e-89c5-3bf88673badc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41b5c080a6c455586b6c9ce1ab9b47b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:45.136364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c76b87dd-f9d9-492e-89c5-3bf88673badc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41b5c080a6c455586b6c9ce1ab9b47b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:45.143481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c76b87dd-f9d9-492e-89c5-3bf88673badc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41b5c080a6c455586b6c9ce1ab9b47b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:45.150592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1256/2506] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:36:44 2022] DELETE /identity/v3/users/a41b5c080a6c455586b6c9ce1ab9b47b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:45.601361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:45.603841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:45.625279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc16da-6aa2-41fc-b555-da3f9f096fac admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:45.681348 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:45.682153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:45.682426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:45.682697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] PATH_INFO: `/v3/projects/5367ac4af84b45f6b10e31974a350cae` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:45.684029 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5367ac4af84b45f6b10e31974a350cae)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:45.685976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:45.771339 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5367ac4af84b45f6b10e31974a350cae', 'request_id': 'req-02c3928a-33f2-479b-9232-68ecc0677792'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:45.776734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5367ac4af84b45f6b10e31974a350cae', 'request_id': 'req-02c3928a-33f2-479b-9232-68ecc0677792'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:45.850081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5367ac4af84b45f6b10e31974a350cae', 'request_id': 'req-02c3928a-33f2-479b-9232-68ecc0677792'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:45.861901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] The token cache is being invalidate because project 5367ac4af84b45f6b10e31974a350cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:36:45.868626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:45.868626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-02c3928a-33f2-479b-9232-68ecc0677792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:36:45.868626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1251/2507] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:36:45 2022] DELETE /identity/v3/projects/5367ac4af84b45f6b10e31974a350cae => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:45.870961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd2cb-856c-4585-8941-fbb6b13f75d5 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:45.871477 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd2cb-856c-4585-8941-fbb6b13f75d5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:45.871586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd2cb-856c-4585-8941-fbb6b13f75d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:45.890069 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-15ebd2cb-856c-4585-8941-fbb6b13f75d5 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:45.891294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-15ebd2cb-856c-4585-8941-fbb6b13f75d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:45.947690 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1257/2508] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:45.957675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292cb88-d156-4cd7-be2c-61c0522ae333 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:45.957988 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292cb88-d156-4cd7-be2c-61c0522ae333 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:45.958260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292cb88-d156-4cd7-be2c-61c0522ae333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:45.976413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c292cb88-d156-4cd7-be2c-61c0522ae333 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:45.977914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c292cb88-d156-4cd7-be2c-61c0522ae333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:45.985911 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1252/2509] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:45.990720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd2cb-856c-4585-8941-fbb6b13f75d5 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:46.000563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd2cb-856c-4585-8941-fbb6b13f75d5 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:46.005717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7ea2a-592a-4ea0-ae23-94f155f2e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:46.006372 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7ea2a-592a-4ea0-ae23-94f155f2e789 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:46.006722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7ea2a-592a-4ea0-ae23-94f155f2e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:46.007029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7ea2a-592a-4ea0-ae23-94f155f2e789 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:46.007800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7ea2a-592a-4ea0-ae23-94f155f2e789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:36:46.008110 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7ea2a-592a-4ea0-ae23-94f155f2e789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:46.009763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7ea2a-592a-4ea0-ae23-94f155f2e789 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:46.021042 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1258/2510] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:36:46.025332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292cb88-d156-4cd7-be2c-61c0522ae333 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:46.034332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292cb88-d156-4cd7-be2c-61c0522ae333 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:46.039048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d90dc-ed20-4ea5-aba8-48952ed79eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:46.039751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d90dc-ed20-4ea5-aba8-48952ed79eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:46.040208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d90dc-ed20-4ea5-aba8-48952ed79eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:46.040653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d90dc-ed20-4ea5-aba8-48952ed79eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:46.041919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d90dc-ed20-4ea5-aba8-48952ed79eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:46.045533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d90dc-ed20-4ea5-aba8-48952ed79eb1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:46.120785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1253/2511] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:36:46 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:36:46.124572 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7ea2a-592a-4ea0-ae23-94f155f2e789 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:46.135106 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7ea2a-592a-4ea0-ae23-94f155f2e789 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:46.197908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2ec83-d41d-47e0-94bf-83aacda0cd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:46.198521 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ec83-d41d-47e0-94bf-83aacda0cd0e admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:46.198809 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ec83-d41d-47e0-94bf-83aacda0cd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:46.199090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ec83-d41d-47e0-94bf-83aacda0cd0e admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:46.199832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2ec83-d41d-47e0-94bf-83aacda0cd0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:46.201785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2ec83-d41d-47e0-94bf-83aacda0cd0e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:46.279139 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1259/2512] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:36:46 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:36:46.283210 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d90dc-ed20-4ea5-aba8-48952ed79eb1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:46.293792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d90dc-ed20-4ea5-aba8-48952ed79eb1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:46.298648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87820660-6db5-4d1c-8b95-5099cfe38f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:46.299352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87820660-6db5-4d1c-8b95-5099cfe38f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:46.301349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87820660-6db5-4d1c-8b95-5099cfe38f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:46.301349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87820660-6db5-4d1c-8b95-5099cfe38f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:46.301349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87820660-6db5-4d1c-8b95-5099cfe38f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:46.302905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87820660-6db5-4d1c-8b95-5099cfe38f3a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:46.313105 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1254/2513] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:46.316906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2ec83-d41d-47e0-94bf-83aacda0cd0e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:46.326738 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2ec83-d41d-47e0-94bf-83aacda0cd0e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:46.331403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903d6ad-f9aa-42b3-b0c5-51b6d9dc0df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:46.332050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903d6ad-f9aa-42b3-b0c5-51b6d9dc0df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:46.332335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903d6ad-f9aa-42b3-b0c5-51b6d9dc0df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:46.332611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903d6ad-f9aa-42b3-b0c5-51b6d9dc0df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:46.333334 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903d6ad-f9aa-42b3-b0c5-51b6d9dc0df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:46.334932 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903d6ad-f9aa-42b3-b0c5-51b6d9dc0df6 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:46.344458 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1260/2514] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:36:46.348275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87820660-6db5-4d1c-8b95-5099cfe38f3a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:46.358914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87820660-6db5-4d1c-8b95-5099cfe38f3a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:46.364687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9e260-5a11-499d-97cf-ed69dc14027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:46.365562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e260-5a11-499d-97cf-ed69dc14027c admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:46.365843 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e260-5a11-499d-97cf-ed69dc14027c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:46.366118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e260-5a11-499d-97cf-ed69dc14027c admin admin] PATH_INFO: `/v3/projects/bc700369ef894dcf8f9bd543a6766739/users/1c580bd30c7f4cc1bc374bc461481047/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:46.380687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9e260-5a11-499d-97cf-ed69dc14027c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc700369ef894dcf8f9bd543a6766739, user_id=1c580bd30c7f4cc1bc374bc461481047, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:46.383543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9e260-5a11-499d-97cf-ed69dc14027c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:46.450914 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1255/2515] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:36:46 2022] PUT /identity/v3/projects/bc700369ef894dcf8f9bd543a6766739/users/1c580bd30c7f4cc1bc374bc461481047/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:36:46.513831 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e497b-3231-4bb2-94d5-0c7b551aede8 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:46.514215 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e497b-3231-4bb2-94d5-0c7b551aede8 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:46.514397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e497b-3231-4bb2-94d5-0c7b551aede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:46.540711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-1f9e497b-3231-4bb2-94d5-0c7b551aede8 None None] MFA Rules not processed for user `1c580bd30c7f4cc1bc374bc461481047`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:46.541919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-1f9e497b-3231-4bb2-94d5-0c7b551aede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:46.604871 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1261/2516] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:36:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:46.616849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9e260-5a11-499d-97cf-ed69dc14027c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:46.618611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-35a9e260-5a11-499d-97cf-ed69dc14027c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:46.674422 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9e260-5a11-499d-97cf-ed69dc14027c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:46.678126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485809f-ee7f-4f82-bb17-cc292431209f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e00de466abe41da8e6d7dbbd71f5270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:46.678785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485809f-ee7f-4f82-bb17-cc292431209f service glance] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:46.679068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485809f-ee7f-4f82-bb17-cc292431209f service glance] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:46.679379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485809f-ee7f-4f82-bb17-cc292431209f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:46.687740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485809f-ee7f-4f82-bb17-cc292431209f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:46.689211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485809f-ee7f-4f82-bb17-cc292431209f service glance] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:46.698154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1256/2517] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:50.125973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e497b-3231-4bb2-94d5-0c7b551aede8 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:50.127397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-1f9e497b-3231-4bb2-94d5-0c7b551aede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:50.184822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e497b-3231-4bb2-94d5-0c7b551aede8 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:50.189260 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b617c3-7f17-47fe-9d16-39f4383a026e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:50.190066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b617c3-7f17-47fe-9d16-39f4383a026e service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:50.190425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b617c3-7f17-47fe-9d16-39f4383a026e service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:50.190712 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b617c3-7f17-47fe-9d16-39f4383a026e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:50.193059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-13b617c3-7f17-47fe-9d16-39f4383a026e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:50.274473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b617c3-7f17-47fe-9d16-39f4383a026e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:50.275964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b617c3-7f17-47fe-9d16-39f4383a026e service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:50.284784 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1262/2518] 10.222.0.64 () {60 vars in 1396 bytes} [Fri May 13 17:36:50 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:50.799271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485809f-ee7f-4f82-bb17-cc292431209f service glance] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:50.807765 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485809f-ee7f-4f82-bb17-cc292431209f service glance] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:50.813585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de32d-c7b8-4f9a-a299-a977d11c1686 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e00de466abe41da8e6d7dbbd71f5270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:50.814228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de32d-c7b8-4f9a-a299-a977d11c1686 service glance] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:50.814511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de32d-c7b8-4f9a-a299-a977d11c1686 service glance] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:50.814781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de32d-c7b8-4f9a-a299-a977d11c1686 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:50.816591 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-df9de32d-c7b8-4f9a-a299-a977d11c1686 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:50.889086 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de32d-c7b8-4f9a-a299-a977d11c1686 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:50.891210 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de32d-c7b8-4f9a-a299-a977d11c1686 service glance] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:50.905302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1257/2519] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:51.135454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b617c3-7f17-47fe-9d16-39f4383a026e service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:51.136880 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-13b617c3-7f17-47fe-9d16-39f4383a026e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:51.191474 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b617c3-7f17-47fe-9d16-39f4383a026e service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:51.195704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac912ab0-3df2-4228-9165-c7829e23ed3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:51.196341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac912ab0-3df2-4228-9165-c7829e23ed3c service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:51.196626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac912ab0-3df2-4228-9165-c7829e23ed3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:51.196900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac912ab0-3df2-4228-9165-c7829e23ed3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:51.198649 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ac912ab0-3df2-4228-9165-c7829e23ed3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:51.207745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac912ab0-3df2-4228-9165-c7829e23ed3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:51.209174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac912ab0-3df2-4228-9165-c7829e23ed3c service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:51.221503 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1263/2520] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:51.294368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de32d-c7b8-4f9a-a299-a977d11c1686 service glance] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:51.304798 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de32d-c7b8-4f9a-a299-a977d11c1686 service glance] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:51.309324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc829-4069-4561-b487-5369150f8135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:51.312076 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc829-4069-4561-b487-5369150f8135 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:51.312511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc829-4069-4561-b487-5369150f8135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:51.312653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc829-4069-4561-b487-5369150f8135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:51.314639 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0c7fc829-4069-4561-b487-5369150f8135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:51.329792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fc829-4069-4561-b487-5369150f8135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:51.331284 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fc829-4069-4561-b487-5369150f8135 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:51.341945 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1258/2521] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:36:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:36:55.949610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe684f3-a837-4d19-be23-fba4ba592ff6 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:55.950141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe684f3-a837-4d19-be23-fba4ba592ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:55.950263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe684f3-a837-4d19-be23-fba4ba592ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:55.968736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-fbe684f3-a837-4d19-be23-fba4ba592ff6 None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:36:55.970002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fbe684f3-a837-4d19-be23-fba4ba592ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:56.040838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1264/2522] 10.222.0.64 () {58 vars in 1009 bytes} [Fri May 13 17:36:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:36:56.053779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc829-4069-4561-b487-5369150f8135 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:36:56.055450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0c7fc829-4069-4561-b487-5369150f8135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:36:56.130655 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc829-4069-4561-b487-5369150f8135 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:36:56.135992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ec0a3-b93e-427f-b6d3-6c9dde54218d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:36:56.136646 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ec0a3-b93e-427f-b6d3-6c9dde54218d service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:36:56.136930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ec0a3-b93e-427f-b6d3-6c9dde54218d service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:36:56.137211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ec0a3-b93e-427f-b6d3-6c9dde54218d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:36:56.145770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ec0a3-b93e-427f-b6d3-6c9dde54218d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:36:56.147582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ec0a3-b93e-427f-b6d3-6c9dde54218d service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:36:56.156342 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1259/2523] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:36:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 17:37:25.205518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe684f3-a837-4d19-be23-fba4ba592ff6 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:25.206955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fbe684f3-a837-4d19-be23-fba4ba592ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:25.223918 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe684f3-a837-4d19-be23-fba4ba592ff6 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:25.231257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf9bf-5d86-4be2-bc67-9122db64ab42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:25.232577 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf9bf-5d86-4be2-bc67-9122db64ab42 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:25.232867 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf9bf-5d86-4be2-bc67-9122db64ab42 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:25.233325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf9bf-5d86-4be2-bc67-9122db64ab42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:25.235185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-83baf9bf-5d86-4be2-bc67-9122db64ab42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:25.255721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf9bf-5d86-4be2-bc67-9122db64ab42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:25.255721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf9bf-5d86-4be2-bc67-9122db64ab42 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:25.260931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1265/2524] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:37:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:37:25.719142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ec0a3-b93e-427f-b6d3-6c9dde54218d service swift] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:25.728517 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ec0a3-b93e-427f-b6d3-6c9dde54218d service swift] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:25.732143 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a748b4-b374-4fba-b733-72c8f50e8ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:25.732768 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a748b4-b374-4fba-b733-72c8f50e8ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:25.733049 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a748b4-b374-4fba-b733-72c8f50e8ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:25.733322 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a748b4-b374-4fba-b733-72c8f50e8ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:25.735079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e7a748b4-b374-4fba-b733-72c8f50e8ad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:25.744951 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a748b4-b374-4fba-b733-72c8f50e8ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:25.746403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a748b4-b374-4fba-b733-72c8f50e8ad7 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:25.754153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1260/2525] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:37:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:37:26.467793 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf9bf-5d86-4be2-bc67-9122db64ab42 service nova] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:26.469224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-83baf9bf-5d86-4be2-bc67-9122db64ab42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:26.482122 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf9bf-5d86-4be2-bc67-9122db64ab42 service nova] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:26.485761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27755cee-0b45-4821-8f81-db9ec1c6eeeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:26.486413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27755cee-0b45-4821-8f81-db9ec1c6eeeb service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:26.486700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27755cee-0b45-4821-8f81-db9ec1c6eeeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:26.486977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27755cee-0b45-4821-8f81-db9ec1c6eeeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:26.488781 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-27755cee-0b45-4821-8f81-db9ec1c6eeeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:26.555498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27755cee-0b45-4821-8f81-db9ec1c6eeeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:26.557130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27755cee-0b45-4821-8f81-db9ec1c6eeeb service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:26.568701 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1266/2526] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:37:28.632972 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54951-7e70-4829-85a9-65b59c882e60 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:28.634141 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54951-7e70-4829-85a9-65b59c882e60 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:28.634435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54951-7e70-4829-85a9-65b59c882e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:28.653481 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c7d54951-7e70-4829-85a9-65b59c882e60 None None] MFA Rules not processed for user `762c7aace59a4d02bf76f1e59bb21f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:37:28.654975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c7d54951-7e70-4829-85a9-65b59c882e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:28.664216 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1261/2527] 10.222.0.64 () {58 vars in 967 bytes} [Fri May 13 17:37:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:37:28.677371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27755cee-0b45-4821-8f81-db9ec1c6eeeb service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:28.689541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27755cee-0b45-4821-8f81-db9ec1c6eeeb service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:28.699924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244c9e4-1c2d-4321-ad6f-9e32cf797c26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973cc524d553428aa2b2763ce28cc920', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:28.701223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c9e4-1c2d-4321-ad6f-9e32cf797c26 service swift] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:28.701677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c9e4-1c2d-4321-ad6f-9e32cf797c26 service swift] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:28.702767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c9e4-1c2d-4321-ad6f-9e32cf797c26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:28.717608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244c9e4-1c2d-4321-ad6f-9e32cf797c26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:28.719365 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244c9e4-1c2d-4321-ad6f-9e32cf797c26 service swift] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:28.729863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1267/2528] 10.222.0.64 () {60 vars in 1384 bytes} [Fri May 13 17:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 17:37:34.290370 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d54951-7e70-4829-85a9-65b59c882e60 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:34.291875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c7d54951-7e70-4829-85a9-65b59c882e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:34.307489 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d54951-7e70-4829-85a9-65b59c882e60 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:34.312222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:34.313096 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:34.313410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:34.313916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] PATH_INFO: `/v3/users/72919bd9efe84fa8acf2b407d7b6b13d` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:34.315222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=72919bd9efe84fa8acf2b407d7b6b13d)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:34.317188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:34.497010 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72919bd9efe84fa8acf2b407d7b6b13d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:34.508808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72919bd9efe84fa8acf2b407d7b6b13d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:34.515463 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72919bd9efe84fa8acf2b407d7b6b13d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:34.516137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72919bd9efe84fa8acf2b407d7b6b13d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:34.587404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72919bd9efe84fa8acf2b407d7b6b13d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:34.593557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1262/2529] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:37:34 2022] DELETE /identity/v3/users/72919bd9efe84fa8acf2b407d7b6b13d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:37:34.823014 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244c9e4-1c2d-4321-ad6f-9e32cf797c26 service swift] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:34.834201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244c9e4-1c2d-4321-ad6f-9e32cf797c26 service swift] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:34.890022 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:34.890820 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:34.891105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:34.891412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] PATH_INFO: `/v3/projects/15f2d05b5ad248009d2acb0d3db6aec9` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:34.892597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f2d05b5ad248009d2acb0d3db6aec9)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:34.894539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:35.027187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f2d05b5ad248009d2acb0d3db6aec9', 'request_id': 'req-28b39925-9acd-42a2-94c9-f31468f3d5c0'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.032592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f2d05b5ad248009d2acb0d3db6aec9', 'request_id': 'req-28b39925-9acd-42a2-94c9-f31468f3d5c0'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.089956 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f2d05b5ad248009d2acb0d3db6aec9', 'request_id': 'req-28b39925-9acd-42a2-94c9-f31468f3d5c0'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.102241 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] The token cache is being invalidate because project 15f2d05b5ad248009d2acb0d3db6aec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:37:35.102517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.103188 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.105048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1268/2530] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:37:34 2022] DELETE /identity/v3/projects/15f2d05b5ad248009d2acb0d3db6aec9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:37:35.109030 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:35.110419 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:35.123997 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357e44-7986-46c2-b88a-873bfcd9b3dc admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:35.179456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:35.180252 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:35.180550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:35.180847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] PATH_INFO: `/v3/users/726055e86775484ca6dfedc355f79af0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:35.182005 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=726055e86775484ca6dfedc355f79af0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:35.183968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:35.337781 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726055e86775484ca6dfedc355f79af0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.349523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726055e86775484ca6dfedc355f79af0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.356555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726055e86775484ca6dfedc355f79af0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.357245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726055e86775484ca6dfedc355f79af0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.398425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726055e86775484ca6dfedc355f79af0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.404550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1263/2531] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:37:35 2022] DELETE /identity/v3/users/726055e86775484ca6dfedc355f79af0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:37:35.639946 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:35.641377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:35.656745 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b39925-9acd-42a2-94c9-f31468f3d5c0 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:35.713689 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:35.714527 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:35.714816 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:35.715153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] PATH_INFO: `/v3/projects/efcb3207c1374d1391e39167ac8785cf` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:35.716680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcb3207c1374d1391e39167ac8785cf)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:35.718633 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:35.832536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcb3207c1374d1391e39167ac8785cf', 'request_id': 'req-c4b7ac63-3a18-403e-bb0b-384e14588d7c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.838441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcb3207c1374d1391e39167ac8785cf', 'request_id': 'req-c4b7ac63-3a18-403e-bb0b-384e14588d7c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.907486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcb3207c1374d1391e39167ac8785cf', 'request_id': 'req-c4b7ac63-3a18-403e-bb0b-384e14588d7c'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.919296 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] The token cache is being invalidate because project efcb3207c1374d1391e39167ac8785cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:37:35.919554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.920215 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c4b7ac63-3a18-403e-bb0b-384e14588d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:35.921768 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1269/2532] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:37:35 2022] DELETE /identity/v3/projects/efcb3207c1374d1391e39167ac8785cf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:37:44.689301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:44.689301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:44.698615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e3e88-87d3-4861-b68e-6a91788c7f48 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:44.756376 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:44.757336 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:44.757716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:44.757994 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] PATH_INFO: `/v3/users/1c580bd30c7f4cc1bc374bc461481047` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:44.759210 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c580bd30c7f4cc1bc374bc461481047)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:44.761184 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:44.906511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c580bd30c7f4cc1bc374bc461481047'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:44.915992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c580bd30c7f4cc1bc374bc461481047'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:44.922823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c580bd30c7f4cc1bc374bc461481047'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:44.923737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c580bd30c7f4cc1bc374bc461481047'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:44.987482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c580bd30c7f4cc1bc374bc461481047'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:44.994513 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1264/2533] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:37:44 2022] DELETE /identity/v3/users/1c580bd30c7f4cc1bc374bc461481047 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:37:44.999030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37194-9a4c-43ed-a4a1-0f9a7553d3cc None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:44.999494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37194-9a4c-43ed-a4a1-0f9a7553d3cc None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:44.999628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37194-9a4c-43ed-a4a1-0f9a7553d3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:45.017046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-00b37194-9a4c-43ed-a4a1-0f9a7553d3cc None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:37:45.021197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-00b37194-9a4c-43ed-a4a1-0f9a7553d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:45.075790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1270/2534] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:37:45.085872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:45.087321 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:45.146317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62a927-f761-4fdf-9a83-2e316273460d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:45.150064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa261ddb-5401-432b-9dc1-92894e04b44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:45.150758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa261ddb-5401-432b-9dc1-92894e04b44f service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:45.151066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa261ddb-5401-432b-9dc1-92894e04b44f service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:45.151371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa261ddb-5401-432b-9dc1-92894e04b44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:45.160255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa261ddb-5401-432b-9dc1-92894e04b44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:45.161708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa261ddb-5401-432b-9dc1-92894e04b44f service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:45.170995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1265/2535] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:37:45.537181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b37194-9a4c-43ed-a4a1-0f9a7553d3cc None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:45.539375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-00b37194-9a4c-43ed-a4a1-0f9a7553d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:45.551183 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b37194-9a4c-43ed-a4a1-0f9a7553d3cc None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:45.556459 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:45.557328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:45.557677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:45.558074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] PATH_INFO: `/v3/projects/bc700369ef894dcf8f9bd543a6766739` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:45.559319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc700369ef894dcf8f9bd543a6766739)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:45.561255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:45.675458 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc700369ef894dcf8f9bd543a6766739', 'request_id': 'req-137c7032-c982-4955-a63d-1869bf03901d'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:45.682995 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc700369ef894dcf8f9bd543a6766739', 'request_id': 'req-137c7032-c982-4955-a63d-1869bf03901d'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:45.752648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc700369ef894dcf8f9bd543a6766739', 'request_id': 'req-137c7032-c982-4955-a63d-1869bf03901d'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:45.764174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] The token cache is being invalidate because project bc700369ef894dcf8f9bd543a6766739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:37:45.764463 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:45.765086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:45.766622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1271/2536] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:37:45 2022] DELETE /identity/v3/projects/bc700369ef894dcf8f9bd543a6766739 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:37:48.412014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa261ddb-5401-432b-9dc1-92894e04b44f service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:48.414148 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fa261ddb-5401-432b-9dc1-92894e04b44f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:48.489538 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa261ddb-5401-432b-9dc1-92894e04b44f service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:48.557869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbc844-db55-4642-8774-20b562a6c37f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:48.560693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbc844-db55-4642-8774-20b562a6c37f service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:48.560693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbc844-db55-4642-8774-20b562a6c37f service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:48.560693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbc844-db55-4642-8774-20b562a6c37f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:48.560996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-48dbc844-db55-4642-8774-20b562a6c37f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:48.574035 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbc844-db55-4642-8774-20b562a6c37f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:48.576056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbc844-db55-4642-8774-20b562a6c37f service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:48.591346 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1266/2537] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:37:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:37:54.605746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:54.607268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:54.660955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c7032-c982-4955-a63d-1869bf03901d admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:54.665332 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bc391-4b4c-4d73-a965-910565d510fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:54.665988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bc391-4b4c-4d73-a965-910565d510fc service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:54.666276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bc391-4b4c-4d73-a965-910565d510fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:54.666555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bc391-4b4c-4d73-a965-910565d510fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:54.668363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-015bc391-4b4c-4d73-a965-910565d510fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:54.731612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bc391-4b4c-4d73-a965-910565d510fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:54.733080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bc391-4b4c-4d73-a965-910565d510fc service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:54.743231 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1272/2538] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:37:58.233059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbc844-db55-4642-8774-20b562a6c37f service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:58.234519 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-48dbc844-db55-4642-8774-20b562a6c37f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:58.248622 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbc844-db55-4642-8774-20b562a6c37f service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:58.253324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506ded7-4626-4821-94a3-33775dda676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:58.254197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506ded7-4626-4821-94a3-33775dda676f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:58.254482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506ded7-4626-4821-94a3-33775dda676f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:58.254758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506ded7-4626-4821-94a3-33775dda676f admin admin] PATH_INFO: `/v3/users/efc23cbdbebc423baed1a2cb6c6cd7e7` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:58.268490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506ded7-4626-4821-94a3-33775dda676f admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc23cbdbebc423baed1a2cb6c6cd7e7)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:58.270384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506ded7-4626-4821-94a3-33775dda676f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:58.446118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f506ded7-4626-4821-94a3-33775dda676f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc23cbdbebc423baed1a2cb6c6cd7e7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:58.458527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f506ded7-4626-4821-94a3-33775dda676f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc23cbdbebc423baed1a2cb6c6cd7e7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:58.465556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f506ded7-4626-4821-94a3-33775dda676f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc23cbdbebc423baed1a2cb6c6cd7e7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:58.466358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f506ded7-4626-4821-94a3-33775dda676f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc23cbdbebc423baed1a2cb6c6cd7e7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:58.506559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f506ded7-4626-4821-94a3-33775dda676f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc23cbdbebc423baed1a2cb6c6cd7e7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:58.514222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1267/2539] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:37:58 2022] DELETE /identity/v3/users/efc23cbdbebc423baed1a2cb6c6cd7e7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:37:58.736696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bc391-4b4c-4d73-a965-910565d510fc service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:58.747052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bc391-4b4c-4d73-a965-910565d510fc service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:58.802640 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:58.803532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:58.803809 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:58.804103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] PATH_INFO: `/v3/projects/f8e7b818f3a74fc48f0faeeb3398069a` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:58.814043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e7b818f3a74fc48f0faeeb3398069a)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:58.816072 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:58.918021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e7b818f3a74fc48f0faeeb3398069a', 'request_id': 'req-944de2ac-e5bf-42d9-aca1-f1030fd745fe'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:58.923238 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e7b818f3a74fc48f0faeeb3398069a', 'request_id': 'req-944de2ac-e5bf-42d9-aca1-f1030fd745fe'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:58.992973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e7b818f3a74fc48f0faeeb3398069a', 'request_id': 'req-944de2ac-e5bf-42d9-aca1-f1030fd745fe'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:59.005082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] The token cache is being invalidate because project f8e7b818f3a74fc48f0faeeb3398069a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:37:59.008680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:59.008680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-944de2ac-e5bf-42d9-aca1-f1030fd745fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:37:59.008680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1273/2540] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:37:58 2022] DELETE /identity/v3/projects/f8e7b818f3a74fc48f0faeeb3398069a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:37:59.014978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119dd7f-f571-4d2c-aba7-404049d28415 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:59.015302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119dd7f-f571-4d2c-aba7-404049d28415 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:59.015577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119dd7f-f571-4d2c-aba7-404049d28415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:59.033765 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6119dd7f-f571-4d2c-aba7-404049d28415 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:37:59.034959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6119dd7f-f571-4d2c-aba7-404049d28415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:59.094739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1268/2541] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:37:59.103147 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d047ca-7028-4c53-aa47-d294de5b74f5 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:59.103437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d047ca-7028-4c53-aa47-d294de5b74f5 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:59.103713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d047ca-7028-4c53-aa47-d294de5b74f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:59.121068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-d9d047ca-7028-4c53-aa47-d294de5b74f5 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:37:59.122266 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-d9d047ca-7028-4c53-aa47-d294de5b74f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:59.130069 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1274/2542] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:37:59.134580 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119dd7f-f571-4d2c-aba7-404049d28415 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:59.144019 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119dd7f-f571-4d2c-aba7-404049d28415 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:59.149120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903166a-6717-4ac2-9e64-9ebae5fd60a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:59.149763 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903166a-6717-4ac2-9e64-9ebae5fd60a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:59.150046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903166a-6717-4ac2-9e64-9ebae5fd60a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:59.150321 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903166a-6717-4ac2-9e64-9ebae5fd60a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:59.151043 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903166a-6717-4ac2-9e64-9ebae5fd60a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:37:59.151382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903166a-6717-4ac2-9e64-9ebae5fd60a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:59.153007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903166a-6717-4ac2-9e64-9ebae5fd60a8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:59.164226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1269/2543] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:37:59.168465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d047ca-7028-4c53-aa47-d294de5b74f5 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:59.177293 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d047ca-7028-4c53-aa47-d294de5b74f5 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:59.181980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39186517-fb9b-4b8a-afc0-f9de3a8cb4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:59.182628 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39186517-fb9b-4b8a-afc0-f9de3a8cb4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:59.182914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39186517-fb9b-4b8a-afc0-f9de3a8cb4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:59.183224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39186517-fb9b-4b8a-afc0-f9de3a8cb4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:59.183919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39186517-fb9b-4b8a-afc0-f9de3a8cb4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:59.185842 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39186517-fb9b-4b8a-afc0-f9de3a8cb4b5 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:59.302799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1275/2544] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:37:59 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:37:59.307382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903166a-6717-4ac2-9e64-9ebae5fd60a8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:59.317695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903166a-6717-4ac2-9e64-9ebae5fd60a8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:59.372641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bacb5-124b-423b-9cd2-eda67e596f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:59.373294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bacb5-124b-423b-9cd2-eda67e596f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:59.373578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bacb5-124b-423b-9cd2-eda67e596f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:59.373856 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bacb5-124b-423b-9cd2-eda67e596f9e admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:59.374547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bacb5-124b-423b-9cd2-eda67e596f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:59.376525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bacb5-124b-423b-9cd2-eda67e596f9e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:59.428593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1270/2545] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:37:59 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:37:59.432966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39186517-fb9b-4b8a-afc0-f9de3a8cb4b5 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:59.443159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39186517-fb9b-4b8a-afc0-f9de3a8cb4b5 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:59.448364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04c997-cf16-4c03-8aac-e0a94733c17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:59.455181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c997-cf16-4c03-8aac-e0a94733c17a admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:59.455181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c997-cf16-4c03-8aac-e0a94733c17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:59.455181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c997-cf16-4c03-8aac-e0a94733c17a admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:59.455181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04c997-cf16-4c03-8aac-e0a94733c17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:59.455181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04c997-cf16-4c03-8aac-e0a94733c17a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:59.461673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1276/2546] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:37:59.465812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bacb5-124b-423b-9cd2-eda67e596f9e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:59.475678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bacb5-124b-423b-9cd2-eda67e596f9e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:59.480555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b647-6082-4116-a799-f9e1d9bcba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:59.481204 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b647-6082-4116-a799-f9e1d9bcba54 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:59.481492 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b647-6082-4116-a799-f9e1d9bcba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:59.481772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b647-6082-4116-a799-f9e1d9bcba54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:59.482494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0b647-6082-4116-a799-f9e1d9bcba54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:59.484142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0b647-6082-4116-a799-f9e1d9bcba54 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:59.496244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1271/2547] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:37:59.500202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04c997-cf16-4c03-8aac-e0a94733c17a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:59.510740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04c997-cf16-4c03-8aac-e0a94733c17a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:59.515540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab43d7-ab39-4bb8-8eea-db8ebc68cfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:59.516426 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab43d7-ab39-4bb8-8eea-db8ebc68cfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:59.516713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab43d7-ab39-4bb8-8eea-db8ebc68cfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:59.516993 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab43d7-ab39-4bb8-8eea-db8ebc68cfc8 admin admin] PATH_INFO: `/v3/projects/ad3c7439a3a64db6a9cb4c565c3a5199/users/21663093e2ad4e8b8e01e78f53222911/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:59.531706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab43d7-ab39-4bb8-8eea-db8ebc68cfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3c7439a3a64db6a9cb4c565c3a5199, user_id=21663093e2ad4e8b8e01e78f53222911, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:59.534421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab43d7-ab39-4bb8-8eea-db8ebc68cfc8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:59.604635 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1277/2548] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:37:59 2022] PUT /identity/v3/projects/ad3c7439a3a64db6a9cb4c565c3a5199/users/21663093e2ad4e8b8e01e78f53222911/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:37:59.614710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fc51b-760a-49d8-87de-1e6d3d6b331b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:59.614998 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fc51b-760a-49d8-87de-1e6d3d6b331b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:59.615313 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fc51b-760a-49d8-87de-1e6d3d6b331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:59.640996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-404fc51b-760a-49d8-87de-1e6d3d6b331b None None] MFA Rules not processed for user `21663093e2ad4e8b8e01e78f53222911`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:37:59.642191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-404fc51b-760a-49d8-87de-1e6d3d6b331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:37:59.703841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1272/2549] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:37:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:37:59.708298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab43d7-ab39-4bb8-8eea-db8ebc68cfc8 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:59.767856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab43d7-ab39-4bb8-8eea-db8ebc68cfc8 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:59.772551 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87043ff3-e825-454d-8081-015284f9eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:59.773746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87043ff3-e825-454d-8081-015284f9eb52 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:59.774030 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87043ff3-e825-454d-8081-015284f9eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:59.774308 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87043ff3-e825-454d-8081-015284f9eb52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:59.775010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87043ff3-e825-454d-8081-015284f9eb52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:59.777451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87043ff3-e825-454d-8081-015284f9eb52 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:59.845204 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1278/2550] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:37:59 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:37:59.849395 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fc51b-760a-49d8-87de-1e6d3d6b331b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:37:59.860450 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fc51b-760a-49d8-87de-1e6d3d6b331b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:37:59.915823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3770-e7e4-40e0-9520-61968223c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:37:59.916494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3770-e7e4-40e0-9520-61968223c656 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:37:59.916776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3770-e7e4-40e0-9520-61968223c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:37:59.917055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3770-e7e4-40e0-9520-61968223c656 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:37:59.917746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a3770-e7e4-40e0-9520-61968223c656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:37:59.919746 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a3770-e7e4-40e0-9520-61968223c656 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:37:59.995084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1273/2551] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:37:59 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:37:59.997700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87043ff3-e825-454d-8081-015284f9eb52 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:00.008056 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87043ff3-e825-454d-8081-015284f9eb52 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:00.012827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5c0fb-6a7e-4780-a916-5aa3fcb2d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:00.013481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5c0fb-6a7e-4780-a916-5aa3fcb2d758 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:00.013770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5c0fb-6a7e-4780-a916-5aa3fcb2d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:00.014100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5c0fb-6a7e-4780-a916-5aa3fcb2d758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:00.014862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5c0fb-6a7e-4780-a916-5aa3fcb2d758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:00.016518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5c0fb-6a7e-4780-a916-5aa3fcb2d758 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:00.027407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1279/2552] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:00.031755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3770-e7e4-40e0-9520-61968223c656 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:00.043760 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3770-e7e4-40e0-9520-61968223c656 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:00.048397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569bf8b-3f58-45f2-b8c5-d633fdf5005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:00.049274 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569bf8b-3f58-45f2-b8c5-d633fdf5005f admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:00.049557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569bf8b-3f58-45f2-b8c5-d633fdf5005f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:00.049837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569bf8b-3f58-45f2-b8c5-d633fdf5005f admin admin] PATH_INFO: `/v3/projects/311165f977c7468bb62c5fb43ea9ae30/users/142b9039806746de9a0c81b28362288b/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:00.068443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569bf8b-3f58-45f2-b8c5-d633fdf5005f admin admin] RBAC: Authorizing `identity:create_grant(project_id=311165f977c7468bb62c5fb43ea9ae30, user_id=142b9039806746de9a0c81b28362288b, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:00.071280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569bf8b-3f58-45f2-b8c5-d633fdf5005f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:00.135814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1274/2553] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:00 2022] PUT /identity/v3/projects/311165f977c7468bb62c5fb43ea9ae30/users/142b9039806746de9a0c81b28362288b/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:00.139765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5c0fb-6a7e-4780-a916-5aa3fcb2d758 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:00.150093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5c0fb-6a7e-4780-a916-5aa3fcb2d758 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:00.202632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b2a1c-46be-4754-99cd-450f47b9500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:00.203311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b2a1c-46be-4754-99cd-450f47b9500f admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:00.203595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b2a1c-46be-4754-99cd-450f47b9500f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:00.203869 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b2a1c-46be-4754-99cd-450f47b9500f admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:00.204586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b2a1c-46be-4754-99cd-450f47b9500f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:00.206181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b2a1c-46be-4754-99cd-450f47b9500f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:00.215975 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1280/2554] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:00.220017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569bf8b-3f58-45f2-b8c5-d633fdf5005f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:00.230948 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569bf8b-3f58-45f2-b8c5-d633fdf5005f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:00.235528 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c2d2-b074-4260-8d95-d26df4f586a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:00.236392 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c2d2-b074-4260-8d95-d26df4f586a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:00.236671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c2d2-b074-4260-8d95-d26df4f586a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:00.236943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c2d2-b074-4260-8d95-d26df4f586a1 admin admin] PATH_INFO: `/v3/projects/311165f977c7468bb62c5fb43ea9ae30/users/142b9039806746de9a0c81b28362288b/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:00.238883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861c2d2-b074-4260-8d95-d26df4f586a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=311165f977c7468bb62c5fb43ea9ae30, user_id=142b9039806746de9a0c81b28362288b, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:00.241584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861c2d2-b074-4260-8d95-d26df4f586a1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:00.251722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1275/2555] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:00 2022] PUT /identity/v3/projects/311165f977c7468bb62c5fb43ea9ae30/users/142b9039806746de9a0c81b28362288b/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:00.261354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2b0a-f190-4e63-a793-3849d3e5eb5a None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:00.261653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2b0a-f190-4e63-a793-3849d3e5eb5a None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:00.261941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2b0a-f190-4e63-a793-3849d3e5eb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:00.288254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-5f2a2b0a-f190-4e63-a793-3849d3e5eb5a None None] MFA Rules not processed for user `142b9039806746de9a0c81b28362288b`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:00.290042 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-5f2a2b0a-f190-4e63-a793-3849d3e5eb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:00.354676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1281/2556] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:00.365250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c2d2-b074-4260-8d95-d26df4f586a1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:00.367049 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b861c2d2-b074-4260-8d95-d26df4f586a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:00.426749 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c2d2-b074-4260-8d95-d26df4f586a1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:00.430380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beab2c-2f74-461a-b0c6-601feae1c252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:00.431019 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beab2c-2f74-461a-b0c6-601feae1c252 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:00.431345 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beab2c-2f74-461a-b0c6-601feae1c252 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:00.431621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beab2c-2f74-461a-b0c6-601feae1c252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:00.440377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beab2c-2f74-461a-b0c6-601feae1c252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:00.441815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beab2c-2f74-461a-b0c6-601feae1c252 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:00.451793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1276/2557] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:00.983729 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2b0a-f190-4e63-a793-3849d3e5eb5a None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:01.043884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2b0a-f190-4e63-a793-3849d3e5eb5a None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:01.048436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:01.049305 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:01.049591 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:01.049870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] PATH_INFO: `/v3/users/21663093e2ad4e8b8e01e78f53222911` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:01.051052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21663093e2ad4e8b8e01e78f53222911)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:01.053094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:01.176955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21663093e2ad4e8b8e01e78f53222911'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:01.188890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21663093e2ad4e8b8e01e78f53222911'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:01.189554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21663093e2ad4e8b8e01e78f53222911'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:01.238321 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21663093e2ad4e8b8e01e78f53222911'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:01.246237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21663093e2ad4e8b8e01e78f53222911'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:01.252316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1282/2558] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:00 2022] DELETE /identity/v3/users/21663093e2ad4e8b8e01e78f53222911 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:01.256953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bfd60-e2ff-44f0-92b0-605026fc2892 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:01.257246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bfd60-e2ff-44f0-92b0-605026fc2892 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:01.257526 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bfd60-e2ff-44f0-92b0-605026fc2892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:01.274954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d15bfd60-e2ff-44f0-92b0-605026fc2892 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:01.276186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d15bfd60-e2ff-44f0-92b0-605026fc2892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:01.332596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1277/2559] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:01.342221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:01.343611 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:01.398613 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f527e2f-b362-46a5-8ef5-76c22dfab680 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:01.402269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079ff3-d055-47ec-bd2c-d1417acc488d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:01.402908 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079ff3-d055-47ec-bd2c-d1417acc488d service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:01.403210 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079ff3-d055-47ec-bd2c-d1417acc488d service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:01.403753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079ff3-d055-47ec-bd2c-d1417acc488d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:01.415714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079ff3-d055-47ec-bd2c-d1417acc488d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:01.415714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079ff3-d055-47ec-bd2c-d1417acc488d service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:01.424725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1283/2560] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:01.806051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bfd60-e2ff-44f0-92b0-605026fc2892 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:01.807540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d15bfd60-e2ff-44f0-92b0-605026fc2892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:01.820361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bfd60-e2ff-44f0-92b0-605026fc2892 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:01.825027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:01.825938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:01.826253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:01.826562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] PATH_INFO: `/v3/projects/ad3c7439a3a64db6a9cb4c565c3a5199` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:01.827770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3c7439a3a64db6a9cb4c565c3a5199)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:01.829720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:01.939919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3c7439a3a64db6a9cb4c565c3a5199', 'request_id': 'req-d1b6be09-0cdb-45b3-b72e-125b315ef572'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:01.945827 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3c7439a3a64db6a9cb4c565c3a5199', 'request_id': 'req-d1b6be09-0cdb-45b3-b72e-125b315ef572'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:02.004413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3c7439a3a64db6a9cb4c565c3a5199', 'request_id': 'req-d1b6be09-0cdb-45b3-b72e-125b315ef572'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:02.016149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] The token cache is being invalidate because project ad3c7439a3a64db6a9cb4c565c3a5199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:02.016435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:02.017080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:02.018659 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1278/2561] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:01 2022] DELETE /identity/v3/projects/ad3c7439a3a64db6a9cb4c565c3a5199 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:02.022776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079ff3-d055-47ec-bd2c-d1417acc488d service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:02.032766 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079ff3-d055-47ec-bd2c-d1417acc488d service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:02.087744 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2325f2-909d-47e4-9d47-85447e7f25c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:02.088613 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2325f2-909d-47e4-9d47-85447e7f25c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:02.088895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2325f2-909d-47e4-9d47-85447e7f25c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:02.089172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2325f2-909d-47e4-9d47-85447e7f25c2 admin admin] PATH_INFO: `/v3/users/142b9039806746de9a0c81b28362288b` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:02.090342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2325f2-909d-47e4-9d47-85447e7f25c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=142b9039806746de9a0c81b28362288b)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:02.092318 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2325f2-909d-47e4-9d47-85447e7f25c2 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:02.285713 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2e2325f2-909d-47e4-9d47-85447e7f25c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142b9039806746de9a0c81b28362288b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:02.296825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2e2325f2-909d-47e4-9d47-85447e7f25c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142b9039806746de9a0c81b28362288b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:02.297484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2e2325f2-909d-47e4-9d47-85447e7f25c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142b9039806746de9a0c81b28362288b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:02.375476 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2e2325f2-909d-47e4-9d47-85447e7f25c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142b9039806746de9a0c81b28362288b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:02.382369 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2e2325f2-909d-47e4-9d47-85447e7f25c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142b9039806746de9a0c81b28362288b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:02.388489 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1284/2562] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:02 2022] DELETE /identity/v3/users/142b9039806746de9a0c81b28362288b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:02.741941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:02.743393 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:02.756406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6be09-0cdb-45b3-b72e-125b315ef572 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:02.819011 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:02.819921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:02.820712 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:02.820983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] PATH_INFO: `/v3/projects/311165f977c7468bb62c5fb43ea9ae30` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:02.822138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=311165f977c7468bb62c5fb43ea9ae30)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:02.824157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:02.939667 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311165f977c7468bb62c5fb43ea9ae30', 'request_id': 'req-6ff501f7-b0dc-468c-955a-44cdb13368aa'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:02.945022 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311165f977c7468bb62c5fb43ea9ae30', 'request_id': 'req-6ff501f7-b0dc-468c-955a-44cdb13368aa'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:03.003657 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311165f977c7468bb62c5fb43ea9ae30', 'request_id': 'req-6ff501f7-b0dc-468c-955a-44cdb13368aa'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:03.015928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] The token cache is being invalidate because project 311165f977c7468bb62c5fb43ea9ae30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:03.016337 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:03.016984 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ff501f7-b0dc-468c-955a-44cdb13368aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:03.018547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1279/2563] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:02 2022] DELETE /identity/v3/projects/311165f977c7468bb62c5fb43ea9ae30 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:03.024284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48115-d8a4-4eab-9a23-449dcaeb64c2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:03.024746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48115-d8a4-4eab-9a23-449dcaeb64c2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:03.024883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48115-d8a4-4eab-9a23-449dcaeb64c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:03.043710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a2c48115-d8a4-4eab-9a23-449dcaeb64c2 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:03.045675 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a2c48115-d8a4-4eab-9a23-449dcaeb64c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:03.105298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1285/2564] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:03.114266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339c933-f9ed-4a7d-a813-c1e157660783 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:03.114557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339c933-f9ed-4a7d-a813-c1e157660783 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:03.114837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339c933-f9ed-4a7d-a813-c1e157660783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:03.133943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c339c933-f9ed-4a7d-a813-c1e157660783 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:03.135177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c339c933-f9ed-4a7d-a813-c1e157660783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:03.143049 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1280/2565] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:03.147374 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48115-d8a4-4eab-9a23-449dcaeb64c2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:03.157137 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48115-d8a4-4eab-9a23-449dcaeb64c2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:03.161698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1085f5d-8216-4ebf-89e6-c2ae8f0feb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:03.163517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085f5d-8216-4ebf-89e6-c2ae8f0feb97 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:03.163517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085f5d-8216-4ebf-89e6-c2ae8f0feb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:03.163517 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085f5d-8216-4ebf-89e6-c2ae8f0feb97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:03.163795 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1085f5d-8216-4ebf-89e6-c2ae8f0feb97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:38:03.163978 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1085f5d-8216-4ebf-89e6-c2ae8f0feb97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:03.165582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1085f5d-8216-4ebf-89e6-c2ae8f0feb97 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:03.176925 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1286/2566] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:38:03.181679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339c933-f9ed-4a7d-a813-c1e157660783 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:03.190648 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339c933-f9ed-4a7d-a813-c1e157660783 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:03.195320 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679375c-37e4-4fdd-a4d9-6f3ee0dc8f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:03.196597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679375c-37e4-4fdd-a4d9-6f3ee0dc8f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:03.196880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679375c-37e4-4fdd-a4d9-6f3ee0dc8f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:03.197156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679375c-37e4-4fdd-a4d9-6f3ee0dc8f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:03.197841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679375c-37e4-4fdd-a4d9-6f3ee0dc8f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:03.199800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679375c-37e4-4fdd-a4d9-6f3ee0dc8f17 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:03.268261 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1281/2567] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:03 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:03.272463 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1085f5d-8216-4ebf-89e6-c2ae8f0feb97 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:03.282402 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1085f5d-8216-4ebf-89e6-c2ae8f0feb97 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:03.337363 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60cd59-a792-4bba-8966-1e16b2f31592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:03.338026 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60cd59-a792-4bba-8966-1e16b2f31592 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:03.338340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60cd59-a792-4bba-8966-1e16b2f31592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:03.338622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60cd59-a792-4bba-8966-1e16b2f31592 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:03.339331 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60cd59-a792-4bba-8966-1e16b2f31592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:03.341270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60cd59-a792-4bba-8966-1e16b2f31592 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:03.392725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1287/2568] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:03 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:03.396831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679375c-37e4-4fdd-a4d9-6f3ee0dc8f17 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:03.407626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679375c-37e4-4fdd-a4d9-6f3ee0dc8f17 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:03.412159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16b975-5b85-4774-ae12-107d9eab2c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:03.412806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16b975-5b85-4774-ae12-107d9eab2c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:03.413085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16b975-5b85-4774-ae12-107d9eab2c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:03.413359 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16b975-5b85-4774-ae12-107d9eab2c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:03.414075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16b975-5b85-4774-ae12-107d9eab2c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:03.415711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16b975-5b85-4774-ae12-107d9eab2c4f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:03.426906 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1282/2569] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:03.430826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60cd59-a792-4bba-8966-1e16b2f31592 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:03.441223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60cd59-a792-4bba-8966-1e16b2f31592 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:03.446761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f719-7a7b-4b42-86eb-99f2272887c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:03.447468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f719-7a7b-4b42-86eb-99f2272887c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:03.447751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f719-7a7b-4b42-86eb-99f2272887c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:03.448023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f719-7a7b-4b42-86eb-99f2272887c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:03.448751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776f719-7a7b-4b42-86eb-99f2272887c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:03.450338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776f719-7a7b-4b42-86eb-99f2272887c2 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:03.460357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1288/2570] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:03.465282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16b975-5b85-4774-ae12-107d9eab2c4f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:03.475490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16b975-5b85-4774-ae12-107d9eab2c4f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:03.480533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea9cf-5242-4daf-896e-9e9184449b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:03.481437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea9cf-5242-4daf-896e-9e9184449b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:03.481722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea9cf-5242-4daf-896e-9e9184449b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:03.484018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea9cf-5242-4daf-896e-9e9184449b97 admin admin] PATH_INFO: `/v3/projects/04121a24307248f78713c267ead6c5f4/users/33472238cd14493084f51815bd123748/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:03.496440 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ea9cf-5242-4daf-896e-9e9184449b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04121a24307248f78713c267ead6c5f4, user_id=33472238cd14493084f51815bd123748, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:03.499118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ea9cf-5242-4daf-896e-9e9184449b97 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:03.558052 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1283/2571] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:03 2022] PUT /identity/v3/projects/04121a24307248f78713c267ead6c5f4/users/33472238cd14493084f51815bd123748/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:03.568513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbd78a-9c76-4a30-923a-17a1ce716249 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:03.568815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbd78a-9c76-4a30-923a-17a1ce716249 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:03.569100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbd78a-9c76-4a30-923a-17a1ce716249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:03.596097 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-21bbd78a-9c76-4a30-923a-17a1ce716249 None None] MFA Rules not processed for user `33472238cd14493084f51815bd123748`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:03.597328 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-21bbd78a-9c76-4a30-923a-17a1ce716249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:03.660306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1289/2572] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:03.672568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea9cf-5242-4daf-896e-9e9184449b97 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:03.674534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9c8ea9cf-5242-4daf-896e-9e9184449b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:03.734318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea9cf-5242-4daf-896e-9e9184449b97 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:03.738582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d27fbc-9d5e-40be-8687-456a902760c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e00de466abe41da8e6d7dbbd71f5270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:03.739318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27fbc-9d5e-40be-8687-456a902760c8 service glance] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:03.739605 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27fbc-9d5e-40be-8687-456a902760c8 service glance] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:03.739882 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27fbc-9d5e-40be-8687-456a902760c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:03.748270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d27fbc-9d5e-40be-8687-456a902760c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:03.749734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d27fbc-9d5e-40be-8687-456a902760c8 service glance] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:03.758708 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1284/2573] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:38:30.173357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbd78a-9c76-4a30-923a-17a1ce716249 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:30.239552 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbd78a-9c76-4a30-923a-17a1ce716249 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:30.244834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc35992-7af6-48d9-8526-4834990d0fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:30.245647 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35992-7af6-48d9-8526-4834990d0fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:30.245935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35992-7af6-48d9-8526-4834990d0fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:30.246211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35992-7af6-48d9-8526-4834990d0fc9 admin admin] PATH_INFO: `/v3/users/33472238cd14493084f51815bd123748` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:30.247435 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc35992-7af6-48d9-8526-4834990d0fc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33472238cd14493084f51815bd123748)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:30.249399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc35992-7af6-48d9-8526-4834990d0fc9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:30.436444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5cc35992-7af6-48d9-8526-4834990d0fc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33472238cd14493084f51815bd123748'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:30.449661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5cc35992-7af6-48d9-8526-4834990d0fc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33472238cd14493084f51815bd123748'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:30.450392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5cc35992-7af6-48d9-8526-4834990d0fc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33472238cd14493084f51815bd123748'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:30.470893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d27fbc-9d5e-40be-8687-456a902760c8 service glance] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:30.472330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-19d27fbc-9d5e-40be-8687-456a902760c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:30.518620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5cc35992-7af6-48d9-8526-4834990d0fc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33472238cd14493084f51815bd123748'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:30.526093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5cc35992-7af6-48d9-8526-4834990d0fc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33472238cd14493084f51815bd123748'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:30.531858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d27fbc-9d5e-40be-8687-456a902760c8 service glance] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:30.536271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1290/2574] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:30 2022] DELETE /identity/v3/users/33472238cd14493084f51815bd123748 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:30.538348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e6e64-fff0-4d8e-9152-e751669c92ea None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:30.538650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e6e64-fff0-4d8e-9152-e751669c92ea None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:30.538934 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e6e64-fff0-4d8e-9152-e751669c92ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:30.558292 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-561e6e64-fff0-4d8e-9152-e751669c92ea None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:30.558982 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-561e6e64-fff0-4d8e-9152-e751669c92ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:30.595189 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e2992-f0b9-4e6c-9f96-b0c980a7f5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:30.595854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e2992-f0b9-4e6c-9f96-b0c980a7f5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:30.596141 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e2992-f0b9-4e6c-9f96-b0c980a7f5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:30.596420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e2992-f0b9-4e6c-9f96-b0c980a7f5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:30.598220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-db9e2992-f0b9-4e6c-9f96-b0c980a7f5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:30.629643 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1291/2575] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:30.639929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e6e64-fff0-4d8e-9152-e751669c92ea None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:30.641516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-561e6e64-fff0-4d8e-9152-e751669c92ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:30.655416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e6e64-fff0-4d8e-9152-e751669c92ea None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:30.659057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c26eb-51ca-4ea2-a4e1-afbc347d083a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:30.659827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c26eb-51ca-4ea2-a4e1-afbc347d083a service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:30.660150 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c26eb-51ca-4ea2-a4e1-afbc347d083a service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:30.660428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c26eb-51ca-4ea2-a4e1-afbc347d083a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:30.669972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c26eb-51ca-4ea2-a4e1-afbc347d083a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:30.671441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c26eb-51ca-4ea2-a4e1-afbc347d083a service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:30.673886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e2992-f0b9-4e6c-9f96-b0c980a7f5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:30.675368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e2992-f0b9-4e6c-9f96-b0c980a7f5f9 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:30.681651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1292/2576] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:38:30.685521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1285/2577] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:38:31.251705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c26eb-51ca-4ea2-a4e1-afbc347d083a service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:31.253209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0a2c26eb-51ca-4ea2-a4e1-afbc347d083a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:31.267579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c26eb-51ca-4ea2-a4e1-afbc347d083a service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:31.273172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:31.274340 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:31.274646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:31.274950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] PATH_INFO: `/v3/projects/04121a24307248f78713c267ead6c5f4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:31.276240 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] RBAC: Authorizing `identity:delete_project(project_id=04121a24307248f78713c267ead6c5f4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:31.278207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:31.357875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04121a24307248f78713c267ead6c5f4', 'request_id': 'req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:31.363597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04121a24307248f78713c267ead6c5f4', 'request_id': 'req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:31.404218 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04121a24307248f78713c267ead6c5f4', 'request_id': 'req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:31.415661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] The token cache is being invalidate because project 04121a24307248f78713c267ead6c5f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:31.416799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:31.416799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4a0fe2e2-04f9-4c16-9efd-72215bd6fdba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:31.418254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1293/2578] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:31 2022] DELETE /identity/v3/projects/04121a24307248f78713c267ead6c5f4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:31.423140 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e9a8-ae01-4f90-ad91-8caa41e7b439 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:31.423445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e9a8-ae01-4f90-ad91-8caa41e7b439 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:31.423723 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e9a8-ae01-4f90-ad91-8caa41e7b439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:31.441215 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b918e9a8-ae01-4f90-ad91-8caa41e7b439 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:31.442437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b918e9a8-ae01-4f90-ad91-8caa41e7b439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:31.501676 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1286/2579] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:31.510565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b7a09-fd59-4b84-b9b8-299962821a54 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:31.510856 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b7a09-fd59-4b84-b9b8-299962821a54 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:31.511151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b7a09-fd59-4b84-b9b8-299962821a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:31.530149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-4f2b7a09-fd59-4b84-b9b8-299962821a54 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:31.531531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-4f2b7a09-fd59-4b84-b9b8-299962821a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:31.539775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1294/2580] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:31.544023 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918e9a8-ae01-4f90-ad91-8caa41e7b439 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:31.554118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918e9a8-ae01-4f90-ad91-8caa41e7b439 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:31.558670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541bd9a-930e-4cdb-9f6d-dd267c1ce32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:31.559355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541bd9a-930e-4cdb-9f6d-dd267c1ce32a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:31.559641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541bd9a-930e-4cdb-9f6d-dd267c1ce32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:31.559919 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541bd9a-930e-4cdb-9f6d-dd267c1ce32a admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:31.560680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541bd9a-930e-4cdb-9f6d-dd267c1ce32a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:38:31.560985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541bd9a-930e-4cdb-9f6d-dd267c1ce32a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:31.562611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541bd9a-930e-4cdb-9f6d-dd267c1ce32a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:31.577716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1287/2581] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:38:31.579168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b7a09-fd59-4b84-b9b8-299962821a54 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:31.588398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b7a09-fd59-4b84-b9b8-299962821a54 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:31.593094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0555a3-033b-4fbd-9aff-d62519dd5fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:31.593751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0555a3-033b-4fbd-9aff-d62519dd5fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:31.594040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0555a3-033b-4fbd-9aff-d62519dd5fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:31.594350 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0555a3-033b-4fbd-9aff-d62519dd5fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:31.595021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0555a3-033b-4fbd-9aff-d62519dd5fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:31.597001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0555a3-033b-4fbd-9aff-d62519dd5fcc admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:31.692185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1295/2582] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:31 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:31.694864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541bd9a-930e-4cdb-9f6d-dd267c1ce32a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:31.704759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541bd9a-930e-4cdb-9f6d-dd267c1ce32a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:31.764830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146caf-2cf1-4009-8e5a-1952918395e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:31.765005 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146caf-2cf1-4009-8e5a-1952918395e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:31.765192 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146caf-2cf1-4009-8e5a-1952918395e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:31.765758 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146caf-2cf1-4009-8e5a-1952918395e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:31.766521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c146caf-2cf1-4009-8e5a-1952918395e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:31.768363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c146caf-2cf1-4009-8e5a-1952918395e0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:31.873687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1288/2583] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:31 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:31.877912 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0555a3-033b-4fbd-9aff-d62519dd5fcc admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:31.889402 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0555a3-033b-4fbd-9aff-d62519dd5fcc admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:31.895212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccfd0a-084a-4033-8570-a6d72da8feec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:31.896020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccfd0a-084a-4033-8570-a6d72da8feec admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:31.896312 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccfd0a-084a-4033-8570-a6d72da8feec admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:31.896596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccfd0a-084a-4033-8570-a6d72da8feec admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:31.897335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccfd0a-084a-4033-8570-a6d72da8feec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:31.899060 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccfd0a-084a-4033-8570-a6d72da8feec admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:31.910522 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1296/2584] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:38:31.915334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146caf-2cf1-4009-8e5a-1952918395e0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:31.929921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146caf-2cf1-4009-8e5a-1952918395e0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:31.935384 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184e323-a6fb-49ae-a39b-1a4b0e8844fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:31.936061 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e323-a6fb-49ae-a39b-1a4b0e8844fa admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:31.936340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e323-a6fb-49ae-a39b-1a4b0e8844fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:31.936614 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e323-a6fb-49ae-a39b-1a4b0e8844fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:31.937889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184e323-a6fb-49ae-a39b-1a4b0e8844fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:31.939702 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184e323-a6fb-49ae-a39b-1a4b0e8844fa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:31.955176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1289/2585] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:31.956986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccfd0a-084a-4033-8570-a6d72da8feec admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:31.969408 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccfd0a-084a-4033-8570-a6d72da8feec admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:31.975741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478dd5c-552c-4fb3-8064-52e65491f389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:31.977362 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478dd5c-552c-4fb3-8064-52e65491f389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:31.977892 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478dd5c-552c-4fb3-8064-52e65491f389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:31.978276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478dd5c-552c-4fb3-8064-52e65491f389 admin admin] PATH_INFO: `/v3/projects/b2cf50c0a4ad40d3979238ef46e476be/users/38578c707f6247eeba8820fae157481c/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:32.000129 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478dd5c-552c-4fb3-8064-52e65491f389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2cf50c0a4ad40d3979238ef46e476be, user_id=38578c707f6247eeba8820fae157481c, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:32.003861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478dd5c-552c-4fb3-8064-52e65491f389 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:32.073982 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1297/2586] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:31 2022] PUT /identity/v3/projects/b2cf50c0a4ad40d3979238ef46e476be/users/38578c707f6247eeba8820fae157481c/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:32.084841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726eede-7a49-43a2-9e2c-d124bcd8fe5c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:32.085132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726eede-7a49-43a2-9e2c-d124bcd8fe5c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:32.085414 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726eede-7a49-43a2-9e2c-d124bcd8fe5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:32.112351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8726eede-7a49-43a2-9e2c-d124bcd8fe5c None None] MFA Rules not processed for user `38578c707f6247eeba8820fae157481c`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:32.113580 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8726eede-7a49-43a2-9e2c-d124bcd8fe5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:32.181412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1290/2587] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:32.188739 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478dd5c-552c-4fb3-8064-52e65491f389 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:32.254773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478dd5c-552c-4fb3-8064-52e65491f389 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:32.260074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e1a7b-1706-49dc-aac5-a1b1eefa2aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:32.260734 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e1a7b-1706-49dc-aac5-a1b1eefa2aad admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:32.261008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e1a7b-1706-49dc-aac5-a1b1eefa2aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:32.261287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e1a7b-1706-49dc-aac5-a1b1eefa2aad admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:32.261972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e1a7b-1706-49dc-aac5-a1b1eefa2aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:32.263935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e1a7b-1706-49dc-aac5-a1b1eefa2aad admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:32.354951 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1298/2588] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:32 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:32.359013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726eede-7a49-43a2-9e2c-d124bcd8fe5c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:32.370960 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726eede-7a49-43a2-9e2c-d124bcd8fe5c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:32.431775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218d06f-6688-4441-82f6-22b47465a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:32.432775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218d06f-6688-4441-82f6-22b47465a014 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:32.432775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218d06f-6688-4441-82f6-22b47465a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:32.433056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218d06f-6688-4441-82f6-22b47465a014 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:32.433717 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218d06f-6688-4441-82f6-22b47465a014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:32.435747 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218d06f-6688-4441-82f6-22b47465a014 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:32.512682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1291/2589] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:32 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:32.516801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e1a7b-1706-49dc-aac5-a1b1eefa2aad admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:32.527730 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e1a7b-1706-49dc-aac5-a1b1eefa2aad admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:32.532696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ed184-3b9e-4968-8b0b-837a8900f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:32.533391 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ed184-3b9e-4968-8b0b-837a8900f771 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:32.533679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ed184-3b9e-4968-8b0b-837a8900f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:32.533955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ed184-3b9e-4968-8b0b-837a8900f771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:32.535203 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ed184-3b9e-4968-8b0b-837a8900f771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:32.536438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ed184-3b9e-4968-8b0b-837a8900f771 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:32.547555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1299/2590] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:32.551645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218d06f-6688-4441-82f6-22b47465a014 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:32.562531 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218d06f-6688-4441-82f6-22b47465a014 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:32.567530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fc24e-1a37-452b-9cbf-a6e92b86ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:32.568812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc24e-1a37-452b-9cbf-a6e92b86ebf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:32.569098 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc24e-1a37-452b-9cbf-a6e92b86ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:32.569378 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc24e-1a37-452b-9cbf-a6e92b86ebf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:32.570108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fc24e-1a37-452b-9cbf-a6e92b86ebf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:32.571816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fc24e-1a37-452b-9cbf-a6e92b86ebf2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:32.581924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1292/2591] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:32.587221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ed184-3b9e-4968-8b0b-837a8900f771 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:32.597479 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ed184-3b9e-4968-8b0b-837a8900f771 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:32.602917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89b87-aaa4-4901-9928-70817b64fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:32.607098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89b87-aaa4-4901-9928-70817b64fb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:32.607098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89b87-aaa4-4901-9928-70817b64fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:32.607098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89b87-aaa4-4901-9928-70817b64fb82 admin admin] PATH_INFO: `/v3/projects/94430421b6aa4e2bb66fb81d85d682f7/users/4f70b05ad7644edf9648fd1424d33357/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:32.621295 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa89b87-aaa4-4901-9928-70817b64fb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94430421b6aa4e2bb66fb81d85d682f7, user_id=4f70b05ad7644edf9648fd1424d33357, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:32.624011 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa89b87-aaa4-4901-9928-70817b64fb82 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:32.696904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1300/2592] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:32 2022] PUT /identity/v3/projects/94430421b6aa4e2bb66fb81d85d682f7/users/4f70b05ad7644edf9648fd1424d33357/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:32.707812 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eead5e-fe67-4c75-86fc-e3734024a8b0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:32.708155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eead5e-fe67-4c75-86fc-e3734024a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:32.709231 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eead5e-fe67-4c75-86fc-e3734024a8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:32.739855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-09eead5e-fe67-4c75-86fc-e3734024a8b0 None None] MFA Rules not processed for user `4f70b05ad7644edf9648fd1424d33357`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:32.741106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-09eead5e-fe67-4c75-86fc-e3734024a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:32.815884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1293/2593] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:32.821063 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89b87-aaa4-4901-9928-70817b64fb82 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:32.889413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89b87-aaa4-4901-9928-70817b64fb82 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:32.894840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0af35b-00b4-4e8a-ad4e-3abd46c0e222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:32.895529 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0af35b-00b4-4e8a-ad4e-3abd46c0e222 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:32.895825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0af35b-00b4-4e8a-ad4e-3abd46c0e222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:32.896802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0af35b-00b4-4e8a-ad4e-3abd46c0e222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:32.897507 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0af35b-00b4-4e8a-ad4e-3abd46c0e222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:32.899459 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0af35b-00b4-4e8a-ad4e-3abd46c0e222 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:32.971720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1301/2594] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:32 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:32.976998 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eead5e-fe67-4c75-86fc-e3734024a8b0 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:32.986905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eead5e-fe67-4c75-86fc-e3734024a8b0 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:33.048505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfba0d-969d-4875-af59-7376f4845b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:33.049162 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfba0d-969d-4875-af59-7376f4845b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:33.049445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfba0d-969d-4875-af59-7376f4845b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:33.049718 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfba0d-969d-4875-af59-7376f4845b5b admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:33.050436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfba0d-969d-4875-af59-7376f4845b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:33.053069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfba0d-969d-4875-af59-7376f4845b5b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:33.146158 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1294/2595] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:32 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:33.150267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0af35b-00b4-4e8a-ad4e-3abd46c0e222 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:33.161300 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0af35b-00b4-4e8a-ad4e-3abd46c0e222 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:33.167267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0cd63-a181-4a96-9a5a-69e5a1286e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:33.167946 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0cd63-a181-4a96-9a5a-69e5a1286e7a admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:33.168234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0cd63-a181-4a96-9a5a-69e5a1286e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:33.168516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0cd63-a181-4a96-9a5a-69e5a1286e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:33.172135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0cd63-a181-4a96-9a5a-69e5a1286e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:33.172135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0cd63-a181-4a96-9a5a-69e5a1286e7a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:33.186288 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1302/2596] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:33.187681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfba0d-969d-4875-af59-7376f4845b5b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:33.198454 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfba0d-969d-4875-af59-7376f4845b5b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:33.203475 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f118b1-067c-4dc4-a20a-041c8fc8e590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:33.204380 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f118b1-067c-4dc4-a20a-041c8fc8e590 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:33.204689 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f118b1-067c-4dc4-a20a-041c8fc8e590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:33.205074 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f118b1-067c-4dc4-a20a-041c8fc8e590 admin admin] PATH_INFO: `/v3/projects/59e0d73035ca4c63ad7ba13e484c045d/users/4a60e7a4756e4949b960e7e8001427d3/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:33.220228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f118b1-067c-4dc4-a20a-041c8fc8e590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e0d73035ca4c63ad7ba13e484c045d, user_id=4a60e7a4756e4949b960e7e8001427d3, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:33.222879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f118b1-067c-4dc4-a20a-041c8fc8e590 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:33.313878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1295/2597] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:33 2022] PUT /identity/v3/projects/59e0d73035ca4c63ad7ba13e484c045d/users/4a60e7a4756e4949b960e7e8001427d3/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:33.317510 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0cd63-a181-4a96-9a5a-69e5a1286e7a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:33.329367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0cd63-a181-4a96-9a5a-69e5a1286e7a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:33.391212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6403f2-75d6-46ac-a08f-47b5398733a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:33.391905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6403f2-75d6-46ac-a08f-47b5398733a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:33.392188 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6403f2-75d6-46ac-a08f-47b5398733a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:33.392466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6403f2-75d6-46ac-a08f-47b5398733a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:33.393192 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6403f2-75d6-46ac-a08f-47b5398733a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:33.394861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6403f2-75d6-46ac-a08f-47b5398733a5 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:33.405751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1303/2598] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:33.409977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f118b1-067c-4dc4-a20a-041c8fc8e590 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:33.420778 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f118b1-067c-4dc4-a20a-041c8fc8e590 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:33.425332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cc1a3-a4a8-480c-a26a-2450352cf55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:33.426206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cc1a3-a4a8-480c-a26a-2450352cf55a admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:33.426493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cc1a3-a4a8-480c-a26a-2450352cf55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:33.426767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cc1a3-a4a8-480c-a26a-2450352cf55a admin admin] PATH_INFO: `/v3/projects/59e0d73035ca4c63ad7ba13e484c045d/users/4a60e7a4756e4949b960e7e8001427d3/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:33.428778 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cc1a3-a4a8-480c-a26a-2450352cf55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e0d73035ca4c63ad7ba13e484c045d, user_id=4a60e7a4756e4949b960e7e8001427d3, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:33.431601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cc1a3-a4a8-480c-a26a-2450352cf55a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:33.449553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1296/2599] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:33 2022] PUT /identity/v3/projects/59e0d73035ca4c63ad7ba13e484c045d/users/4a60e7a4756e4949b960e7e8001427d3/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:33.454206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b7ab9-1d0a-4535-b19d-d93e11a85102 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:33.454501 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b7ab9-1d0a-4535-b19d-d93e11a85102 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:33.454973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b7ab9-1d0a-4535-b19d-d93e11a85102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:33.484256 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-8b5b7ab9-1d0a-4535-b19d-d93e11a85102 None None] MFA Rules not processed for user `4a60e7a4756e4949b960e7e8001427d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:33.485519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8b5b7ab9-1d0a-4535-b19d-d93e11a85102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:33.562851 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1304/2600] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:33.574927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cc1a3-a4a8-480c-a26a-2450352cf55a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:33.576676 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-446cc1a3-a4a8-480c-a26a-2450352cf55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:33.636465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cc1a3-a4a8-480c-a26a-2450352cf55a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:33.640196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b387e21-28e2-44c8-a542-c6099ca2feb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:33.640857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b387e21-28e2-44c8-a542-c6099ca2feb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:33.641140 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b387e21-28e2-44c8-a542-c6099ca2feb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:33.641421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b387e21-28e2-44c8-a542-c6099ca2feb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:33.704281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b387e21-28e2-44c8-a542-c6099ca2feb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:33.706930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b387e21-28e2-44c8-a542-c6099ca2feb8 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:33.715693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1297/2601] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:38:34.598639 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b7ab9-1d0a-4535-b19d-d93e11a85102 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:34.600821 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8b5b7ab9-1d0a-4535-b19d-d93e11a85102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:34.675988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b7ab9-1d0a-4535-b19d-d93e11a85102 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:34.684547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea493de-52e8-4300-943e-77275ed46a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:34.685561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea493de-52e8-4300-943e-77275ed46a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:34.686367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea493de-52e8-4300-943e-77275ed46a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:34.686367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea493de-52e8-4300-943e-77275ed46a9b admin admin] PATH_INFO: `/v3/users/dfc52b61bcf845d1953a5a111abb3666` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:34.701775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea493de-52e8-4300-943e-77275ed46a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc52b61bcf845d1953a5a111abb3666)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:34.703765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea493de-52e8-4300-943e-77275ed46a9b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:34.932736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-aea493de-52e8-4300-943e-77275ed46a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc52b61bcf845d1953a5a111abb3666'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:34.944525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-aea493de-52e8-4300-943e-77275ed46a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc52b61bcf845d1953a5a111abb3666'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:34.945274 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-aea493de-52e8-4300-943e-77275ed46a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc52b61bcf845d1953a5a111abb3666'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:35.010025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-aea493de-52e8-4300-943e-77275ed46a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc52b61bcf845d1953a5a111abb3666'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:35.017413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-aea493de-52e8-4300-943e-77275ed46a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc52b61bcf845d1953a5a111abb3666'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:35.023444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1305/2602] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:34 2022] DELETE /identity/v3/users/dfc52b61bcf845d1953a5a111abb3666 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:35.279587 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b387e21-28e2-44c8-a542-c6099ca2feb8 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:35.290938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b387e21-28e2-44c8-a542-c6099ca2feb8 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:35.347814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:35.348679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:35.348961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:35.349233 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] PATH_INFO: `/v3/projects/ae7b37b41d944427945d783a460ca12a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:35.359828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7b37b41d944427945d783a460ca12a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:35.361764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:35.513027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7b37b41d944427945d783a460ca12a', 'request_id': 'req-72745351-c7e5-497e-9167-9ebd47d5b97c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:35.518179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7b37b41d944427945d783a460ca12a', 'request_id': 'req-72745351-c7e5-497e-9167-9ebd47d5b97c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:35.608485 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7b37b41d944427945d783a460ca12a', 'request_id': 'req-72745351-c7e5-497e-9167-9ebd47d5b97c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:35.620841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] The token cache is being invalidate because project ae7b37b41d944427945d783a460ca12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:35.622779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:35.622779 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-72745351-c7e5-497e-9167-9ebd47d5b97c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:35.623512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1298/2603] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:35 2022] DELETE /identity/v3/projects/ae7b37b41d944427945d783a460ca12a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:35.628667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc149e-e5d8-45b2-9b88-00d8bde1c44d None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:35.629130 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc149e-e5d8-45b2-9b88-00d8bde1c44d None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:35.629247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc149e-e5d8-45b2-9b88-00d8bde1c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:35.647933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-2dcc149e-e5d8-45b2-9b88-00d8bde1c44d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:35.649138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2dcc149e-e5d8-45b2-9b88-00d8bde1c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:35.706516 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1306/2604] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:35.715106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba162235-9ea0-4ff9-ae04-5e196f5f0f16 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:35.715556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba162235-9ea0-4ff9-ae04-5e196f5f0f16 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:35.716040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba162235-9ea0-4ff9-ae04-5e196f5f0f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:35.733943 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ba162235-9ea0-4ff9-ae04-5e196f5f0f16 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:35.735186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ba162235-9ea0-4ff9-ae04-5e196f5f0f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:35.743108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1299/2605] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:35.747303 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc149e-e5d8-45b2-9b88-00d8bde1c44d None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:35.757076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc149e-e5d8-45b2-9b88-00d8bde1c44d None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:35.761778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc69de9-d82a-4f6f-a58d-d5b4efa51624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:35.762436 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc69de9-d82a-4f6f-a58d-d5b4efa51624 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:35.762721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc69de9-d82a-4f6f-a58d-d5b4efa51624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:35.763079 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc69de9-d82a-4f6f-a58d-d5b4efa51624 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:35.763815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc69de9-d82a-4f6f-a58d-d5b4efa51624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:38:35.764149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc69de9-d82a-4f6f-a58d-d5b4efa51624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:35.765765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc69de9-d82a-4f6f-a58d-d5b4efa51624 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:35.777725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1307/2606] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:38:35.781871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba162235-9ea0-4ff9-ae04-5e196f5f0f16 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:35.790980 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba162235-9ea0-4ff9-ae04-5e196f5f0f16 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:35.795731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37928688-2146-4f17-bef3-cdf47b767e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:35.796369 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37928688-2146-4f17-bef3-cdf47b767e60 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:35.796653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37928688-2146-4f17-bef3-cdf47b767e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:35.796933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37928688-2146-4f17-bef3-cdf47b767e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:35.797629 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37928688-2146-4f17-bef3-cdf47b767e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:35.799581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37928688-2146-4f17-bef3-cdf47b767e60 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:35.878410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1300/2607] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:35 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:38:35.883553 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc69de9-d82a-4f6f-a58d-d5b4efa51624 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:35.893307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc69de9-d82a-4f6f-a58d-d5b4efa51624 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:35.949546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fbf3f-cce4-4001-96cc-279d723d3b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:35.950228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fbf3f-cce4-4001-96cc-279d723d3b97 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:35.950515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fbf3f-cce4-4001-96cc-279d723d3b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:35.950796 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fbf3f-cce4-4001-96cc-279d723d3b97 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:35.951537 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fbf3f-cce4-4001-96cc-279d723d3b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:35.953484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fbf3f-cce4-4001-96cc-279d723d3b97 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:36.090434 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1308/2608] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:35 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:36.091692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37928688-2146-4f17-bef3-cdf47b767e60 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:36.102239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37928688-2146-4f17-bef3-cdf47b767e60 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:36.107140 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31387c-9313-4c19-8e7e-dcea2a1ba664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:36.110442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31387c-9313-4c19-8e7e-dcea2a1ba664 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:36.110442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31387c-9313-4c19-8e7e-dcea2a1ba664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:36.110442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31387c-9313-4c19-8e7e-dcea2a1ba664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:36.110442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31387c-9313-4c19-8e7e-dcea2a1ba664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:36.110839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31387c-9313-4c19-8e7e-dcea2a1ba664 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:36.121836 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1301/2609] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:36.125781 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fbf3f-cce4-4001-96cc-279d723d3b97 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:36.150541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fbf3f-cce4-4001-96cc-279d723d3b97 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:36.180003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556057e0-505a-4877-8d76-8cbd851a01ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:36.180693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556057e0-505a-4877-8d76-8cbd851a01ec admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:36.180979 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556057e0-505a-4877-8d76-8cbd851a01ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:36.181256 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556057e0-505a-4877-8d76-8cbd851a01ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:36.181974 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556057e0-505a-4877-8d76-8cbd851a01ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:36.183652 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556057e0-505a-4877-8d76-8cbd851a01ec admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:36.193816 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1309/2610] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:36.197927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31387c-9313-4c19-8e7e-dcea2a1ba664 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:36.238960 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31387c-9313-4c19-8e7e-dcea2a1ba664 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:36.244121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53568b-d615-4ab8-84b6-fa6ebb3d5be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:36.245269 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53568b-d615-4ab8-84b6-fa6ebb3d5be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:36.245552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53568b-d615-4ab8-84b6-fa6ebb3d5be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:36.245829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53568b-d615-4ab8-84b6-fa6ebb3d5be9 admin admin] PATH_INFO: `/v3/projects/069b83114eaf4bab8e839aea9dc1c47a/users/4c1722034e6c4554b5cbc0269348de4e/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:36.260426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53568b-d615-4ab8-84b6-fa6ebb3d5be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069b83114eaf4bab8e839aea9dc1c47a, user_id=4c1722034e6c4554b5cbc0269348de4e, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:36.263852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53568b-d615-4ab8-84b6-fa6ebb3d5be9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:36.331021 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1302/2611] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:36 2022] PUT /identity/v3/projects/069b83114eaf4bab8e839aea9dc1c47a/users/4c1722034e6c4554b5cbc0269348de4e/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:36.344847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb670-2490-4bb3-8d10-a5e08f797375 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:36.345138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb670-2490-4bb3-8d10-a5e08f797375 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:36.345461 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb670-2490-4bb3-8d10-a5e08f797375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:36.382164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-544eb670-2490-4bb3-8d10-a5e08f797375 None None] MFA Rules not processed for user `4c1722034e6c4554b5cbc0269348de4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:36.383409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-544eb670-2490-4bb3-8d10-a5e08f797375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:36.448404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1310/2612] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:38:36.452831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53568b-d615-4ab8-84b6-fa6ebb3d5be9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:36.518019 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53568b-d615-4ab8-84b6-fa6ebb3d5be9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:36.523652 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25294c0d-56d8-4521-9803-a51ca98897ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:36.524317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25294c0d-56d8-4521-9803-a51ca98897ee admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:36.524600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25294c0d-56d8-4521-9803-a51ca98897ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:36.524880 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25294c0d-56d8-4521-9803-a51ca98897ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:36.525583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25294c0d-56d8-4521-9803-a51ca98897ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:36.527568 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25294c0d-56d8-4521-9803-a51ca98897ee admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:36.622764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1303/2613] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:36 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:36.629031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eb670-2490-4bb3-8d10-a5e08f797375 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:36.638445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eb670-2490-4bb3-8d10-a5e08f797375 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:36.695255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ab6c-e177-45ea-b42d-f06d69ea3f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:36.696054 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ab6c-e177-45ea-b42d-f06d69ea3f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:36.696372 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ab6c-e177-45ea-b42d-f06d69ea3f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:36.696763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ab6c-e177-45ea-b42d-f06d69ea3f29 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:36.697511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718ab6c-e177-45ea-b42d-f06d69ea3f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:36.699495 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718ab6c-e177-45ea-b42d-f06d69ea3f29 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:36.744565 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25294c0d-56d8-4521-9803-a51ca98897ee admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:36.746277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-25294c0d-56d8-4521-9803-a51ca98897ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:36.775269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1311/2614] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:36 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:38:36.779403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ab6c-e177-45ea-b42d-f06d69ea3f29 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:36.789748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ab6c-e177-45ea-b42d-f06d69ea3f29 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:36.794622 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430e006-cf3d-4726-b15b-07df4daa9efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:36.795410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430e006-cf3d-4726-b15b-07df4daa9efd admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:36.795695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430e006-cf3d-4726-b15b-07df4daa9efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:36.795969 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430e006-cf3d-4726-b15b-07df4daa9efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:36.796718 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430e006-cf3d-4726-b15b-07df4daa9efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:36.798593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430e006-cf3d-4726-b15b-07df4daa9efd admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:36.809258 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1312/2615] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:38:36.814759 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430e006-cf3d-4726-b15b-07df4daa9efd admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:36.821007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25294c0d-56d8-4521-9803-a51ca98897ee admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:36.824646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430e006-cf3d-4726-b15b-07df4daa9efd admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:36.824775 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8bec3-5613-45ca-83c9-f847fd7ec3c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:36.825289 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8bec3-5613-45ca-83c9-f847fd7ec3c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:36.825619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8bec3-5613-45ca-83c9-f847fd7ec3c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:36.825900 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8bec3-5613-45ca-83c9-f847fd7ec3c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:36.827674 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9da8bec3-5613-45ca-83c9-f847fd7ec3c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:36.829699 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f009-7510-4041-a96a-31d79f6d4a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:36.830566 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f009-7510-4041-a96a-31d79f6d4a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:36.830910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f009-7510-4041-a96a-31d79f6d4a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:36.831221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f009-7510-4041-a96a-31d79f6d4a8a admin admin] PATH_INFO: `/v3/projects/47aad63f42c84dc8a50f07928f3d6545/users/d27d15a31ff3469bab80f5951cd89d36/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:36.845698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157f009-7510-4041-a96a-31d79f6d4a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47aad63f42c84dc8a50f07928f3d6545, user_id=d27d15a31ff3469bab80f5951cd89d36, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:36.848399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157f009-7510-4041-a96a-31d79f6d4a8a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:36.885147 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8bec3-5613-45ca-83c9-f847fd7ec3c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:36.886543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8bec3-5613-45ca-83c9-f847fd7ec3c7 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:36.895302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1304/2616] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:38:36.918996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1313/2617] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:36 2022] PUT /identity/v3/projects/47aad63f42c84dc8a50f07928f3d6545/users/d27d15a31ff3469bab80f5951cd89d36/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:36.922826 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8bec3-5613-45ca-83c9-f847fd7ec3c7 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:36.933921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8bec3-5613-45ca-83c9-f847fd7ec3c7 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:36.993566 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9741225-1da1-4c9a-8fad-35b726293cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:36.994239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741225-1da1-4c9a-8fad-35b726293cac admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:36.994518 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741225-1da1-4c9a-8fad-35b726293cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:36.994790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741225-1da1-4c9a-8fad-35b726293cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:36.995550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9741225-1da1-4c9a-8fad-35b726293cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:36.997312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9741225-1da1-4c9a-8fad-35b726293cac admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:37.008183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1305/2618] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:37.012276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f009-7510-4041-a96a-31d79f6d4a8a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:37.022706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f009-7510-4041-a96a-31d79f6d4a8a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:37.027435 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289824cd-b624-41d7-b120-96478eb592ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:37.028309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289824cd-b624-41d7-b120-96478eb592ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:37.028586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289824cd-b624-41d7-b120-96478eb592ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:37.028857 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289824cd-b624-41d7-b120-96478eb592ce admin admin] PATH_INFO: `/v3/projects/47aad63f42c84dc8a50f07928f3d6545/users/d27d15a31ff3469bab80f5951cd89d36/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:37.030851 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289824cd-b624-41d7-b120-96478eb592ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=47aad63f42c84dc8a50f07928f3d6545, user_id=d27d15a31ff3469bab80f5951cd89d36, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:37.033550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289824cd-b624-41d7-b120-96478eb592ce admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:37.043571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1314/2619] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:37 2022] PUT /identity/v3/projects/47aad63f42c84dc8a50f07928f3d6545/users/d27d15a31ff3469bab80f5951cd89d36/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:37.055423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e42b5-b31b-4eeb-80e6-72d08de971b7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:37.055711 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e42b5-b31b-4eeb-80e6-72d08de971b7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:37.055990 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e42b5-b31b-4eeb-80e6-72d08de971b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:37.081894 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0d5e42b5-b31b-4eeb-80e6-72d08de971b7 None None] MFA Rules not processed for user `d27d15a31ff3469bab80f5951cd89d36`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:37.083093 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0d5e42b5-b31b-4eeb-80e6-72d08de971b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:37.152921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1306/2620] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:37.160378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289824cd-b624-41d7-b120-96478eb592ce admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:37.162902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-289824cd-b624-41d7-b120-96478eb592ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:37.250392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289824cd-b624-41d7-b120-96478eb592ce admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:37.254161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72593a63-e9df-45cb-bd9f-05adbfdc8a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:37.254825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593a63-e9df-45cb-bd9f-05adbfdc8a37 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:37.255106 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593a63-e9df-45cb-bd9f-05adbfdc8a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:37.255413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593a63-e9df-45cb-bd9f-05adbfdc8a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:37.265167 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72593a63-e9df-45cb-bd9f-05adbfdc8a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:37.266868 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72593a63-e9df-45cb-bd9f-05adbfdc8a37 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:37.277988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1315/2621] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:37.341480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e42b5-b31b-4eeb-80e6-72d08de971b7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:37.402823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e42b5-b31b-4eeb-80e6-72d08de971b7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:37.407521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:37.408431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:37.408710 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:37.408982 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] PATH_INFO: `/v3/users/4c1722034e6c4554b5cbc0269348de4e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:37.410219 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1722034e6c4554b5cbc0269348de4e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:37.412778 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:37.584572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1722034e6c4554b5cbc0269348de4e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:37.597499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1722034e6c4554b5cbc0269348de4e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:37.605394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1722034e6c4554b5cbc0269348de4e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:37.606095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1722034e6c4554b5cbc0269348de4e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:37.666735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1722034e6c4554b5cbc0269348de4e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:37.673160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1307/2622] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:37 2022] DELETE /identity/v3/users/4c1722034e6c4554b5cbc0269348de4e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:37.677905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010ee40-8303-46e9-be2c-acfbd4823a6d None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:37.678389 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010ee40-8303-46e9-be2c-acfbd4823a6d None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:37.678505 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010ee40-8303-46e9-be2c-acfbd4823a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:37.704399 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a010ee40-8303-46e9-be2c-acfbd4823a6d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:37.705641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a010ee40-8303-46e9-be2c-acfbd4823a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:37.765002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1316/2623] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:37.775114 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:37.776585 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:37.853846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be991fbe-c7d3-4b02-b144-91911f629a2b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:37.857792 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7346f-2273-46c2-8683-f47b3cff77c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:37.858490 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7346f-2273-46c2-8683-f47b3cff77c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:37.858929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7346f-2273-46c2-8683-f47b3cff77c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:37.859257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7346f-2273-46c2-8683-f47b3cff77c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:37.868569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7346f-2273-46c2-8683-f47b3cff77c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:37.870040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7346f-2273-46c2-8683-f47b3cff77c6 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:37.880294 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1308/2624] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:38.265254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010ee40-8303-46e9-be2c-acfbd4823a6d None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:38.266700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a010ee40-8303-46e9-be2c-acfbd4823a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:38.332085 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010ee40-8303-46e9-be2c-acfbd4823a6d None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:38.336168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ed30-9873-457c-b55b-022842e82a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:38.338715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ed30-9873-457c-b55b-022842e82a30 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:38.338715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ed30-9873-457c-b55b-022842e82a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:38.338715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ed30-9873-457c-b55b-022842e82a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:38.345853 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ede7ed30-9873-457c-b55b-022842e82a30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:38.419324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7ed30-9873-457c-b55b-022842e82a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:38.420798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7ed30-9873-457c-b55b-022842e82a30 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:38.443972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1317/2625] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:38.765411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7346f-2273-46c2-8683-f47b3cff77c6 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:38.766950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-09b7346f-2273-46c2-8683-f47b3cff77c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:38.780851 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7346f-2273-46c2-8683-f47b3cff77c6 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:38.787871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:38.789110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:38.789569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:38.790253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] PATH_INFO: `/v3/projects/069b83114eaf4bab8e839aea9dc1c47a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:38.791641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=069b83114eaf4bab8e839aea9dc1c47a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:38.794399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:38.927776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069b83114eaf4bab8e839aea9dc1c47a', 'request_id': 'req-554683ef-d027-45a5-a9b8-e6c271171eea'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:38.939675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069b83114eaf4bab8e839aea9dc1c47a', 'request_id': 'req-554683ef-d027-45a5-a9b8-e6c271171eea'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:39.038808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069b83114eaf4bab8e839aea9dc1c47a', 'request_id': 'req-554683ef-d027-45a5-a9b8-e6c271171eea'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:39.059653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] The token cache is being invalidate because project 069b83114eaf4bab8e839aea9dc1c47a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:39.059884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:39.060849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:39.065828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1309/2626] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:38 2022] DELETE /identity/v3/projects/069b83114eaf4bab8e839aea9dc1c47a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:39.066883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ed30-9873-457c-b55b-022842e82a30 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:39.078740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ed30-9873-457c-b55b-022842e82a30 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:39.283377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdc9d1-39c5-418f-8d2a-0773d80a9971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:39.284583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdc9d1-39c5-418f-8d2a-0773d80a9971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:39.285053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdc9d1-39c5-418f-8d2a-0773d80a9971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:39.285483 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdc9d1-39c5-418f-8d2a-0773d80a9971 admin admin] PATH_INFO: `/v3/users/d27d15a31ff3469bab80f5951cd89d36` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:39.288070 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdc9d1-39c5-418f-8d2a-0773d80a9971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27d15a31ff3469bab80f5951cd89d36)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:39.290971 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdc9d1-39c5-418f-8d2a-0773d80a9971 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:39.543218 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-febdc9d1-39c5-418f-8d2a-0773d80a9971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27d15a31ff3469bab80f5951cd89d36'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:39.558114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-febdc9d1-39c5-418f-8d2a-0773d80a9971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27d15a31ff3469bab80f5951cd89d36'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:39.558914 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-febdc9d1-39c5-418f-8d2a-0773d80a9971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27d15a31ff3469bab80f5951cd89d36'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:39.638725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-febdc9d1-39c5-418f-8d2a-0773d80a9971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27d15a31ff3469bab80f5951cd89d36'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:39.647864 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-febdc9d1-39c5-418f-8d2a-0773d80a9971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27d15a31ff3469bab80f5951cd89d36'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:39.656987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1318/2627] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:39 2022] DELETE /identity/v3/users/d27d15a31ff3469bab80f5951cd89d36 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:40.310288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:40.312641 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:40.336671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554683ef-d027-45a5-a9b8-e6c271171eea admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:40.416009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:40.416983 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:40.417265 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:40.417540 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] PATH_INFO: `/v3/projects/47aad63f42c84dc8a50f07928f3d6545` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:40.421555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47aad63f42c84dc8a50f07928f3d6545)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:40.421555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:40.555465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47aad63f42c84dc8a50f07928f3d6545', 'request_id': 'req-217c7744-36cb-4396-a535-3386de201a6a'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:40.561472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47aad63f42c84dc8a50f07928f3d6545', 'request_id': 'req-217c7744-36cb-4396-a535-3386de201a6a'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:40.614372 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47aad63f42c84dc8a50f07928f3d6545', 'request_id': 'req-217c7744-36cb-4396-a535-3386de201a6a'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:40.631530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] The token cache is being invalidate because project 47aad63f42c84dc8a50f07928f3d6545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:40.631967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:40.633018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-217c7744-36cb-4396-a535-3386de201a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:40.634769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1310/2628] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:40 2022] DELETE /identity/v3/projects/47aad63f42c84dc8a50f07928f3d6545 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:40.641514 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c8af-52d1-4338-96a5-f3ebb8353624 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:40.642023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c8af-52d1-4338-96a5-f3ebb8353624 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:40.642134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c8af-52d1-4338-96a5-f3ebb8353624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:40.662965 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-ed62c8af-52d1-4338-96a5-f3ebb8353624 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:40.664587 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ed62c8af-52d1-4338-96a5-f3ebb8353624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:40.729191 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1319/2629] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:40.738123 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395f52b-1a66-4e30-bba3-0567bd112c67 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:40.738460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395f52b-1a66-4e30-bba3-0567bd112c67 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:40.738740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395f52b-1a66-4e30-bba3-0567bd112c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:40.759928 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c395f52b-1a66-4e30-bba3-0567bd112c67 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:40.761130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c395f52b-1a66-4e30-bba3-0567bd112c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:40.769421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1311/2630] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:40.833883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62c8af-52d1-4338-96a5-f3ebb8353624 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:40.833883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62c8af-52d1-4338-96a5-f3ebb8353624 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:40.833883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba7729-9612-4f1c-b023-882397241780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:40.833883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7729-9612-4f1c-b023-882397241780 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:40.834375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7729-9612-4f1c-b023-882397241780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:40.834375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7729-9612-4f1c-b023-882397241780 admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:40.834375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba7729-9612-4f1c-b023-882397241780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:38:40.834375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba7729-9612-4f1c-b023-882397241780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:40.834375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba7729-9612-4f1c-b023-882397241780 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:40.834375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1320/2631] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:38:40.834873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395f52b-1a66-4e30-bba3-0567bd112c67 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:40.834873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395f52b-1a66-4e30-bba3-0567bd112c67 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:40.834873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d4cdd-e366-4d46-8625-8983c6907834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:40.834873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d4cdd-e366-4d46-8625-8983c6907834 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:40.835283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d4cdd-e366-4d46-8625-8983c6907834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:40.835283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d4cdd-e366-4d46-8625-8983c6907834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:40.835283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d4cdd-e366-4d46-8625-8983c6907834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:40.835283 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d4cdd-e366-4d46-8625-8983c6907834 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:40.975497 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1312/2632] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:40 2022] POST /identity/v3/projects => generated 399 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:40.976986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba7729-9612-4f1c-b023-882397241780 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:40.988931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba7729-9612-4f1c-b023-882397241780 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:41.046105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9acc2a-9db5-4cb9-9a7c-049405b058db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:41.046774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9acc2a-9db5-4cb9-9a7c-049405b058db admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:41.047059 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9acc2a-9db5-4cb9-9a7c-049405b058db admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:41.047367 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9acc2a-9db5-4cb9-9a7c-049405b058db admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:41.048061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9acc2a-9db5-4cb9-9a7c-049405b058db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:41.050025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9acc2a-9db5-4cb9-9a7c-049405b058db admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:41.127081 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1321/2633] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:40 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:41.128375 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d4cdd-e366-4d46-8625-8983c6907834 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:41.138736 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d4cdd-e366-4d46-8625-8983c6907834 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:41.144134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c935e2-1df6-4411-a02e-9178643f87d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:41.144806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c935e2-1df6-4411-a02e-9178643f87d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:41.145097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c935e2-1df6-4411-a02e-9178643f87d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:41.145391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c935e2-1df6-4411-a02e-9178643f87d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:41.146222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c935e2-1df6-4411-a02e-9178643f87d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:41.147930 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c935e2-1df6-4411-a02e-9178643f87d6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:41.159937 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1313/2634] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:41.164433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9acc2a-9db5-4cb9-9a7c-049405b058db admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:41.174593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9acc2a-9db5-4cb9-9a7c-049405b058db admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:41.179955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a16ea-1a52-4340-ae47-0883c26c6931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:41.180618 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a16ea-1a52-4340-ae47-0883c26c6931 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:41.180904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a16ea-1a52-4340-ae47-0883c26c6931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:41.181184 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a16ea-1a52-4340-ae47-0883c26c6931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:41.181920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a16ea-1a52-4340-ae47-0883c26c6931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:41.183571 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a16ea-1a52-4340-ae47-0883c26c6931 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:41.197287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1322/2635] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:41.198433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c935e2-1df6-4411-a02e-9178643f87d6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:41.208351 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c935e2-1df6-4411-a02e-9178643f87d6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:41.212924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1cf07-9798-4051-bd67-de180a26c796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:41.213801 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1cf07-9798-4051-bd67-de180a26c796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:41.214081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1cf07-9798-4051-bd67-de180a26c796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:41.214353 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1cf07-9798-4051-bd67-de180a26c796 admin admin] PATH_INFO: `/v3/projects/e0751871ed30466eab6ec48cfbbe3b44/users/5b89a0945bd14bcaa3015c623fbee446/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:41.229729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1cf07-9798-4051-bd67-de180a26c796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0751871ed30466eab6ec48cfbbe3b44, user_id=5b89a0945bd14bcaa3015c623fbee446, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:41.232534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1cf07-9798-4051-bd67-de180a26c796 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:41.324906 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1314/2636] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:41 2022] PUT /identity/v3/projects/e0751871ed30466eab6ec48cfbbe3b44/users/5b89a0945bd14bcaa3015c623fbee446/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:41.335948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33a15b-d51b-49da-be95-b0fffbf8f51e None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:41.336290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33a15b-d51b-49da-be95-b0fffbf8f51e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:41.336511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33a15b-d51b-49da-be95-b0fffbf8f51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:41.363917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-2b33a15b-d51b-49da-be95-b0fffbf8f51e None None] MFA Rules not processed for user `5b89a0945bd14bcaa3015c623fbee446`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:41.365138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2b33a15b-d51b-49da-be95-b0fffbf8f51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:41.429152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1323/2637] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:41.433653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1cf07-9798-4051-bd67-de180a26c796 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:41.499349 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1cf07-9798-4051-bd67-de180a26c796 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:41.504496 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c923df-33ae-4165-9f36-bf25fdee5682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:41.505196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c923df-33ae-4165-9f36-bf25fdee5682 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:41.505477 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c923df-33ae-4165-9f36-bf25fdee5682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:41.505778 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c923df-33ae-4165-9f36-bf25fdee5682 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:41.506483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c923df-33ae-4165-9f36-bf25fdee5682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:41.508476 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c923df-33ae-4165-9f36-bf25fdee5682 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:41.592279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1315/2638] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:41 2022] POST /identity/v3/projects => generated 401 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:38:41.593500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33a15b-d51b-49da-be95-b0fffbf8f51e None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:41.605774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33a15b-d51b-49da-be95-b0fffbf8f51e None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:41.666257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae7524-54f0-46c1-ac6c-355537e99f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:41.667015 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7524-54f0-46c1-ac6c-355537e99f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:41.667387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7524-54f0-46c1-ac6c-355537e99f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:41.667737 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7524-54f0-46c1-ac6c-355537e99f73 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:41.668449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae7524-54f0-46c1-ac6c-355537e99f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:41.670398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae7524-54f0-46c1-ac6c-355537e99f73 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:41.809984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1324/2639] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:41 2022] POST /identity/v3/users => generated 307 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:41.814556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c923df-33ae-4165-9f36-bf25fdee5682 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:41.824970 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c923df-33ae-4165-9f36-bf25fdee5682 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:41.829521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91ee7-b7ef-4ad1-a5bc-3813ee884f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:41.830187 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91ee7-b7ef-4ad1-a5bc-3813ee884f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:41.830471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91ee7-b7ef-4ad1-a5bc-3813ee884f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:41.830748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91ee7-b7ef-4ad1-a5bc-3813ee884f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:41.831551 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b91ee7-b7ef-4ad1-a5bc-3813ee884f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:41.833291 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b91ee7-b7ef-4ad1-a5bc-3813ee884f8f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:41.847590 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1316/2640] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:41.848855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae7524-54f0-46c1-ac6c-355537e99f73 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:41.860531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae7524-54f0-46c1-ac6c-355537e99f73 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:41.866277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b2a52-2757-4de1-ab98-87ca7c31f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:41.867105 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b2a52-2757-4de1-ab98-87ca7c31f96c admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:41.867705 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b2a52-2757-4de1-ab98-87ca7c31f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:41.867822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b2a52-2757-4de1-ab98-87ca7c31f96c admin admin] PATH_INFO: `/v3/projects/34b0432f2d2941c3bb3dca84cb3bfc86/users/9812c931cbb1450f8517a9baf7e98c88/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:41.883589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b2a52-2757-4de1-ab98-87ca7c31f96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b0432f2d2941c3bb3dca84cb3bfc86, user_id=9812c931cbb1450f8517a9baf7e98c88, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:41.886421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b2a52-2757-4de1-ab98-87ca7c31f96c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:41.947756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1325/2641] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:41 2022] PUT /identity/v3/projects/34b0432f2d2941c3bb3dca84cb3bfc86/users/9812c931cbb1450f8517a9baf7e98c88/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:41.951602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91ee7-b7ef-4ad1-a5bc-3813ee884f8f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:41.962218 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91ee7-b7ef-4ad1-a5bc-3813ee884f8f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:41.988666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9941-fd87-4b76-9501-9febe170d416 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:41.989040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9941-fd87-4b76-9501-9febe170d416 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:41.989233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9941-fd87-4b76-9501-9febe170d416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:42.007324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-83ce9941-fd87-4b76-9501-9febe170d416 None None] MFA Rules not processed for user `45482c562be6438ebd456ee9512ef3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:42.008630 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-83ce9941-fd87-4b76-9501-9febe170d416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:42.020055 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efed2c6-05f0-4e3a-bdbb-915d37a07b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:42.021387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed2c6-05f0-4e3a-bdbb-915d37a07b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:42.021741 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed2c6-05f0-4e3a-bdbb-915d37a07b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:42.022088 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed2c6-05f0-4e3a-bdbb-915d37a07b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:42.022991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efed2c6-05f0-4e3a-bdbb-915d37a07b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:42.024608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efed2c6-05f0-4e3a-bdbb-915d37a07b08 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:42.037975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1317/2642] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:42.039098 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efed2c6-05f0-4e3a-bdbb-915d37a07b08 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:42.049040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efed2c6-05f0-4e3a-bdbb-915d37a07b08 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:42.054377 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2eec6-b9d5-49f3-81dc-7a425ce38436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:42.055278 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2eec6-b9d5-49f3-81dc-7a425ce38436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:42.055583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2eec6-b9d5-49f3-81dc-7a425ce38436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:42.055846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2eec6-b9d5-49f3-81dc-7a425ce38436 admin admin] PATH_INFO: `/v3/projects/34b0432f2d2941c3bb3dca84cb3bfc86/users/9812c931cbb1450f8517a9baf7e98c88/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:42.057839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2eec6-b9d5-49f3-81dc-7a425ce38436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b0432f2d2941c3bb3dca84cb3bfc86, user_id=9812c931cbb1450f8517a9baf7e98c88, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:42.060665 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2eec6-b9d5-49f3-81dc-7a425ce38436 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:42.065377 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1326/2643] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:38:42.071885 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1318/2644] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:42 2022] PUT /identity/v3/projects/34b0432f2d2941c3bb3dca84cb3bfc86/users/9812c931cbb1450f8517a9baf7e98c88/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:42.083213 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8367b5-e02f-4b28-a650-d74c8d87579c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:42.083592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8367b5-e02f-4b28-a650-d74c8d87579c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:42.083874 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8367b5-e02f-4b28-a650-d74c8d87579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:42.118440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-7f8367b5-e02f-4b28-a650-d74c8d87579c None None] MFA Rules not processed for user `9812c931cbb1450f8517a9baf7e98c88`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:42.118440 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7f8367b5-e02f-4b28-a650-d74c8d87579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:42.195239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1327/2645] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:42 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:42.206290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2eec6-b9d5-49f3-81dc-7a425ce38436 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:42.208005 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d5d2eec6-b9d5-49f3-81dc-7a425ce38436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:42.267655 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2eec6-b9d5-49f3-81dc-7a425ce38436 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:42.271391 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f747699-089c-45d3-80d5-92b7ad817a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:42.272033 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f747699-089c-45d3-80d5-92b7ad817a9c service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:42.272335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f747699-089c-45d3-80d5-92b7ad817a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:42.272611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f747699-089c-45d3-80d5-92b7ad817a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:42.281546 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f747699-089c-45d3-80d5-92b7ad817a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:42.283121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f747699-089c-45d3-80d5-92b7ad817a9c service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:42.292757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1319/2646] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:42 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:42.394608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8367b5-e02f-4b28-a650-d74c8d87579c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:42.396072 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7f8367b5-e02f-4b28-a650-d74c8d87579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:42.453484 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8367b5-e02f-4b28-a650-d74c8d87579c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:42.457140 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2f13d-1a3f-4b70-a07a-63746149c993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:42.459672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2f13d-1a3f-4b70-a07a-63746149c993 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:42.459672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2f13d-1a3f-4b70-a07a-63746149c993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:42.459672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2f13d-1a3f-4b70-a07a-63746149c993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:42.460275 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a2d2f13d-1a3f-4b70-a07a-63746149c993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:42.470039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2f13d-1a3f-4b70-a07a-63746149c993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:42.471570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2f13d-1a3f-4b70-a07a-63746149c993 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:42.480366 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1328/2647] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:42.564084 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f747699-089c-45d3-80d5-92b7ad817a9c service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:42.565607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5f747699-089c-45d3-80d5-92b7ad817a9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:42.578934 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f747699-089c-45d3-80d5-92b7ad817a9c service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:42.583942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d49ac-f170-42be-b09b-29807233f277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:42.584664 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d49ac-f170-42be-b09b-29807233f277 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:42.585020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d49ac-f170-42be-b09b-29807233f277 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:42.585399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d49ac-f170-42be-b09b-29807233f277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:42.643330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d49ac-f170-42be-b09b-29807233f277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:42.644893 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d49ac-f170-42be-b09b-29807233f277 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:42.654133 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1320/2648] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:43.446806 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2f13d-1a3f-4b70-a07a-63746149c993 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:43.448838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a2d2f13d-1a3f-4b70-a07a-63746149c993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:43.524902 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2f13d-1a3f-4b70-a07a-63746149c993 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:43.530054 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6d2b9-fc89-408f-8cb5-3b2eb92186c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84ae21424694df68a96b928e15e9240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:43.530702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6d2b9-fc89-408f-8cb5-3b2eb92186c4 service placement] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:43.531050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6d2b9-fc89-408f-8cb5-3b2eb92186c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:43.531822 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6d2b9-fc89-408f-8cb5-3b2eb92186c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:43.533279 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-bea6d2b9-fc89-408f-8cb5-3b2eb92186c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:43.545866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6d2b9-fc89-408f-8cb5-3b2eb92186c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:43.547502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6d2b9-fc89-408f-8cb5-3b2eb92186c4 service placement] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:43.558879 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1329/2649] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:44.652697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d49ac-f170-42be-b09b-29807233f277 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:44.654104 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8c9d49ac-f170-42be-b09b-29807233f277 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:44.720341 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d49ac-f170-42be-b09b-29807233f277 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:44.724895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:44.725786 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:44.726064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:44.726361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] PATH_INFO: `/v3/users/38578c707f6247eeba8820fae157481c` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:44.727991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=38578c707f6247eeba8820fae157481c)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:44.730195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:44.977153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38578c707f6247eeba8820fae157481c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:44.989142 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38578c707f6247eeba8820fae157481c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:44.997772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38578c707f6247eeba8820fae157481c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:44.997942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38578c707f6247eeba8820fae157481c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:45.118500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38578c707f6247eeba8820fae157481c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:45.124822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1321/2650] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:44 2022] DELETE /identity/v3/users/38578c707f6247eeba8820fae157481c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:45.134460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79411d4-d411-455b-bfc7-2aed41053792 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:45.134460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79411d4-d411-455b-bfc7-2aed41053792 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:45.134460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79411d4-d411-455b-bfc7-2aed41053792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:45.147596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-f79411d4-d411-455b-bfc7-2aed41053792 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:45.153784 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f79411d4-d411-455b-bfc7-2aed41053792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:45.205749 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1330/2651] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:45.215486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:45.216892 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:45.273200 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4d49-0edb-4bf8-9ba0-54574d3e9d6d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:45.276989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc1bd3-8b0c-491c-8f7a-3a87e68dc272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:45.277640 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc1bd3-8b0c-491c-8f7a-3a87e68dc272 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:45.277923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc1bd3-8b0c-491c-8f7a-3a87e68dc272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:45.278196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc1bd3-8b0c-491c-8f7a-3a87e68dc272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:45.287456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc1bd3-8b0c-491c-8f7a-3a87e68dc272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:45.288915 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc1bd3-8b0c-491c-8f7a-3a87e68dc272 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:45.299662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1322/2652] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:45.720319 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79411d4-d411-455b-bfc7-2aed41053792 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:45.721861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f79411d4-d411-455b-bfc7-2aed41053792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:45.752771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79411d4-d411-455b-bfc7-2aed41053792 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:45.752771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:45.753931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:45.753931 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:45.754261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] PATH_INFO: `/v3/projects/b2cf50c0a4ad40d3979238ef46e476be` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:45.755486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2cf50c0a4ad40d3979238ef46e476be)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:45.757515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:45.843037 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc1bd3-8b0c-491c-8f7a-3a87e68dc272 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:45.844601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-26fc1bd3-8b0c-491c-8f7a-3a87e68dc272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:45.856806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc1bd3-8b0c-491c-8f7a-3a87e68dc272 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:45.860403 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f1d6b-80a7-481e-b4d0-307c818671af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:45.861367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1d6b-80a7-481e-b4d0-307c818671af service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:45.861823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1d6b-80a7-481e-b4d0-307c818671af service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:45.862259 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1d6b-80a7-481e-b4d0-307c818671af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:45.866363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8c9f1d6b-80a7-481e-b4d0-307c818671af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:45.880051 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f1d6b-80a7-481e-b4d0-307c818671af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:45.881706 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f1d6b-80a7-481e-b4d0-307c818671af service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:45.883943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2cf50c0a4ad40d3979238ef46e476be', 'request_id': 'req-8d010d1f-be50-4bb7-8991-515a7a957522'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:45.890722 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2cf50c0a4ad40d3979238ef46e476be', 'request_id': 'req-8d010d1f-be50-4bb7-8991-515a7a957522'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:45.893835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1323/2653] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:45.981475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2cf50c0a4ad40d3979238ef46e476be', 'request_id': 'req-8d010d1f-be50-4bb7-8991-515a7a957522'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:45.994309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] The token cache is being invalidate because project b2cf50c0a4ad40d3979238ef46e476be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:45.995719 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:45.996018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:45.997991 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1331/2654] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:45 2022] DELETE /identity/v3/projects/b2cf50c0a4ad40d3979238ef46e476be => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:46.001740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f1d6b-80a7-481e-b4d0-307c818671af service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:46.011978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f1d6b-80a7-481e-b4d0-307c818671af service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:46.071175 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:46.071703 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:46.071996 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:46.072256 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] PATH_INFO: `/v3/users/4f70b05ad7644edf9648fd1424d33357` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:46.073536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f70b05ad7644edf9648fd1424d33357)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:46.075562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:46.283978 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f70b05ad7644edf9648fd1424d33357'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:46.299383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f70b05ad7644edf9648fd1424d33357'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:46.308885 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f70b05ad7644edf9648fd1424d33357'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:46.308992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f70b05ad7644edf9648fd1424d33357'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:46.415851 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f70b05ad7644edf9648fd1424d33357'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:46.422849 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1324/2655] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:46 2022] DELETE /identity/v3/users/4f70b05ad7644edf9648fd1424d33357 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:46.845986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:46.847563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:46.862574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010d1f-be50-4bb7-8991-515a7a957522 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:46.926150 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:46.927210 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:46.927824 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:46.928826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] PATH_INFO: `/v3/projects/94430421b6aa4e2bb66fb81d85d682f7` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:46.930205 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=94430421b6aa4e2bb66fb81d85d682f7)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:46.932580 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:47.153446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94430421b6aa4e2bb66fb81d85d682f7', 'request_id': 'req-c18d3be4-45dd-4507-b2fe-d4c490053bbe'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:47.160410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94430421b6aa4e2bb66fb81d85d682f7', 'request_id': 'req-c18d3be4-45dd-4507-b2fe-d4c490053bbe'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:47.261285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94430421b6aa4e2bb66fb81d85d682f7', 'request_id': 'req-c18d3be4-45dd-4507-b2fe-d4c490053bbe'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:47.273585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] The token cache is being invalidate because project 94430421b6aa4e2bb66fb81d85d682f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:47.273877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:47.274543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:47.276131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1332/2656] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:46 2022] DELETE /identity/v3/projects/94430421b6aa4e2bb66fb81d85d682f7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:47.280174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:47.281713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:47.295581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c3789-9c27-452c-a315-b8e321408fc8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:47.353825 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:47.354966 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:47.355289 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:47.355569 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] PATH_INFO: `/v3/users/4a60e7a4756e4949b960e7e8001427d3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:47.356760 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a60e7a4756e4949b960e7e8001427d3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:47.358782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:47.585275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a60e7a4756e4949b960e7e8001427d3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:47.599737 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a60e7a4756e4949b960e7e8001427d3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:47.606048 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a60e7a4756e4949b960e7e8001427d3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:47.606777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a60e7a4756e4949b960e7e8001427d3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:47.669550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a60e7a4756e4949b960e7e8001427d3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:47.679362 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1325/2657] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:47 2022] DELETE /identity/v3/users/4a60e7a4756e4949b960e7e8001427d3 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:47.889290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:47.890926 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:47.908397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d3be4-45dd-4507-b2fe-d4c490053bbe admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:48.001407 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac067dd-5c63-4488-97a4-6a52f6be9f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:48.002861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac067dd-5c63-4488-97a4-6a52f6be9f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:48.003175 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac067dd-5c63-4488-97a4-6a52f6be9f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:48.004071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac067dd-5c63-4488-97a4-6a52f6be9f77 admin admin] PATH_INFO: `/v3/users/5b89a0945bd14bcaa3015c623fbee446` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:48.024666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac067dd-5c63-4488-97a4-6a52f6be9f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b89a0945bd14bcaa3015c623fbee446)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:48.026735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac067dd-5c63-4488-97a4-6a52f6be9f77 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:48.259679 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:48.261530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:48.276315 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dd0b9-a89c-4551-b94c-7cd72054676d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:48.298268 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:48.300366 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-eac067dd-5c63-4488-97a4-6a52f6be9f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b89a0945bd14bcaa3015c623fbee446'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:48.303924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:48.304680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:48.305748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] PATH_INFO: `/v3/projects/59e0d73035ca4c63ad7ba13e484c045d` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:48.317015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e0d73035ca4c63ad7ba13e484c045d)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:48.317015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:48.349702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-eac067dd-5c63-4488-97a4-6a52f6be9f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b89a0945bd14bcaa3015c623fbee446'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:48.351402 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-eac067dd-5c63-4488-97a4-6a52f6be9f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b89a0945bd14bcaa3015c623fbee446'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:48.429942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e0d73035ca4c63ad7ba13e484c045d', 'request_id': 'req-d11bf43c-de33-4488-a827-20cdda372803'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:48.433357 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-eac067dd-5c63-4488-97a4-6a52f6be9f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b89a0945bd14bcaa3015c623fbee446'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:48.436057 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e0d73035ca4c63ad7ba13e484c045d', 'request_id': 'req-d11bf43c-de33-4488-a827-20cdda372803'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:48.442168 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-eac067dd-5c63-4488-97a4-6a52f6be9f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b89a0945bd14bcaa3015c623fbee446'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:48.448589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1333/2658] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:47 2022] DELETE /identity/v3/users/5b89a0945bd14bcaa3015c623fbee446 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:48.453906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c591c-43d8-46c1-b29a-6fb97e9ba5b1 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:48.454414 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c591c-43d8-46c1-b29a-6fb97e9ba5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:48.454692 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c591c-43d8-46c1-b29a-6fb97e9ba5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:48.472907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-974c591c-43d8-46c1-b29a-6fb97e9ba5b1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:48.474159 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-974c591c-43d8-46c1-b29a-6fb97e9ba5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:48.506920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e0d73035ca4c63ad7ba13e484c045d', 'request_id': 'req-d11bf43c-de33-4488-a827-20cdda372803'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:48.519548 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] The token cache is being invalidate because project 59e0d73035ca4c63ad7ba13e484c045d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:48.519942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:48.520673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d11bf43c-de33-4488-a827-20cdda372803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:48.522804 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1326/2659] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:48 2022] DELETE /identity/v3/projects/59e0d73035ca4c63ad7ba13e484c045d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:48.527509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627e9df-4ed1-438c-a63e-877bb61a6156 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:48.531053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627e9df-4ed1-438c-a63e-877bb61a6156 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:48.531053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627e9df-4ed1-438c-a63e-877bb61a6156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:48.540074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1334/2660] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:48.547769 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d627e9df-4ed1-438c-a63e-877bb61a6156 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:48.549072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d627e9df-4ed1-438c-a63e-877bb61a6156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:48.549725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c591c-43d8-46c1-b29a-6fb97e9ba5b1 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:48.551314 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-974c591c-43d8-46c1-b29a-6fb97e9ba5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:48.557790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1327/2661] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:38:48.565762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7facf-5c7f-44bf-be37-02e0dde4a49b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:48.566221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7facf-5c7f-44bf-be37-02e0dde4a49b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:48.566509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7facf-5c7f-44bf-be37-02e0dde4a49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:48.585157 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-41d7facf-5c7f-44bf-be37-02e0dde4a49b None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:48.586309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-41d7facf-5c7f-44bf-be37-02e0dde4a49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:48.595251 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1328/2662] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:48.599524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7facf-5c7f-44bf-be37-02e0dde4a49b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:48.610694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7facf-5c7f-44bf-be37-02e0dde4a49b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:48.617712 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f62d9b-771e-4a21-b1d7-705c774efe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:48.618457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62d9b-771e-4a21-b1d7-705c774efe51 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:48.618790 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62d9b-771e-4a21-b1d7-705c774efe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:48.619069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62d9b-771e-4a21-b1d7-705c774efe51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:48.619746 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c591c-43d8-46c1-b29a-6fb97e9ba5b1 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:48.619869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f62d9b-771e-4a21-b1d7-705c774efe51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:38:48.620153 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f62d9b-771e-4a21-b1d7-705c774efe51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:48.621789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f62d9b-771e-4a21-b1d7-705c774efe51 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:48.623563 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96200b4d-91c6-4189-8ebf-fbc014036974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:48.624297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96200b4d-91c6-4189-8ebf-fbc014036974 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:48.624970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96200b4d-91c6-4189-8ebf-fbc014036974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:48.624970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96200b4d-91c6-4189-8ebf-fbc014036974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:48.635415 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96200b4d-91c6-4189-8ebf-fbc014036974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:48.637166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1329/2663] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:38:48.639308 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96200b4d-91c6-4189-8ebf-fbc014036974 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:48.644117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f62d9b-771e-4a21-b1d7-705c774efe51 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:48.651222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1335/2664] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:38:48.654760 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f62d9b-771e-4a21-b1d7-705c774efe51 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:48.660280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5476d0d-ce94-4e7e-ae8b-b16d730fc290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:48.660546 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5476d0d-ce94-4e7e-ae8b-b16d730fc290 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:48.660780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5476d0d-ce94-4e7e-ae8b-b16d730fc290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:48.661040 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5476d0d-ce94-4e7e-ae8b-b16d730fc290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:48.661794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5476d0d-ce94-4e7e-ae8b-b16d730fc290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:48.664260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5476d0d-ce94-4e7e-ae8b-b16d730fc290 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:48.748508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1330/2665] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:48 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:48.752330 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96200b4d-91c6-4189-8ebf-fbc014036974 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:48.762118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96200b4d-91c6-4189-8ebf-fbc014036974 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:48.836614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fe21f-e98b-4b1d-8caf-eeedcd5eddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:48.837224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe21f-e98b-4b1d-8caf-eeedcd5eddb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:48.837662 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe21f-e98b-4b1d-8caf-eeedcd5eddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:48.838061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe21f-e98b-4b1d-8caf-eeedcd5eddb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:48.838646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fe21f-e98b-4b1d-8caf-eeedcd5eddb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:48.840602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fe21f-e98b-4b1d-8caf-eeedcd5eddb4 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:48.931731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1336/2666] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:48 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:48.935581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5476d0d-ce94-4e7e-ae8b-b16d730fc290 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:48.948852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5476d0d-ce94-4e7e-ae8b-b16d730fc290 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:48.954700 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e510f38-48c5-4ebb-b56a-1931e4da22ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:48.955995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e510f38-48c5-4ebb-b56a-1931e4da22ca admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:48.956447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e510f38-48c5-4ebb-b56a-1931e4da22ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:48.956906 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e510f38-48c5-4ebb-b56a-1931e4da22ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:48.957808 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e510f38-48c5-4ebb-b56a-1931e4da22ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:48.960976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e510f38-48c5-4ebb-b56a-1931e4da22ca admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:48.975704 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1331/2667] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:48.980903 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fe21f-e98b-4b1d-8caf-eeedcd5eddb4 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:48.992798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fe21f-e98b-4b1d-8caf-eeedcd5eddb4 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:48.999704 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81335f-b851-4188-a547-f20ff9a1a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:49.000882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81335f-b851-4188-a547-f20ff9a1a9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:49.001372 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81335f-b851-4188-a547-f20ff9a1a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:49.001847 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81335f-b851-4188-a547-f20ff9a1a9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:49.003010 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81335f-b851-4188-a547-f20ff9a1a9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:49.004685 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81335f-b851-4188-a547-f20ff9a1a9bd admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:49.016229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1337/2668] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:49.021296 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e510f38-48c5-4ebb-b56a-1931e4da22ca admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:49.032993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e510f38-48c5-4ebb-b56a-1931e4da22ca admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:49.041397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef27f2-00ac-474b-8207-1df321be3a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:49.042371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef27f2-00ac-474b-8207-1df321be3a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:49.043673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef27f2-00ac-474b-8207-1df321be3a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:49.050069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef27f2-00ac-474b-8207-1df321be3a88 admin admin] PATH_INFO: `/v3/projects/88f7defdcc1d481583e29665df3e5a00/users/db2dd8757a284c2484538e288e214c80/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:49.061658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef27f2-00ac-474b-8207-1df321be3a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f7defdcc1d481583e29665df3e5a00, user_id=db2dd8757a284c2484538e288e214c80, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:49.064575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef27f2-00ac-474b-8207-1df321be3a88 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:49.126342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81335f-b851-4188-a547-f20ff9a1a9bd admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:49.138482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3c81335f-b851-4188-a547-f20ff9a1a9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:49.145120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1332/2669] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:49 2022] PUT /identity/v3/projects/88f7defdcc1d481583e29665df3e5a00/users/db2dd8757a284c2484538e288e214c80/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:49.160883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b72a-49d7-44ed-b3d7-ffbc090d7be8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:49.163321 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b72a-49d7-44ed-b3d7-ffbc090d7be8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:49.164115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b72a-49d7-44ed-b3d7-ffbc090d7be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:49.200971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-28e9b72a-49d7-44ed-b3d7-ffbc090d7be8 None None] MFA Rules not processed for user `db2dd8757a284c2484538e288e214c80`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:49.202390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-28e9b72a-49d7-44ed-b3d7-ffbc090d7be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:49.214451 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81335f-b851-4188-a547-f20ff9a1a9bd admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:49.302309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1333/2670] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:49.313731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:49.313731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:49.313731 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:49.314082 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] PATH_INFO: `/v3/projects/e0751871ed30466eab6ec48cfbbe3b44` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:49.315102 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0751871ed30466eab6ec48cfbbe3b44)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:49.317161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:49.318165 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9b72a-49d7-44ed-b3d7-ffbc090d7be8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:49.322953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-28e9b72a-49d7-44ed-b3d7-ffbc090d7be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:49.409762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9b72a-49d7-44ed-b3d7-ffbc090d7be8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:49.415365 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572483c4-ddf7-43ee-aa33-4f210d6203fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:49.416185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572483c4-ddf7-43ee-aa33-4f210d6203fc service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:49.416530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572483c4-ddf7-43ee-aa33-4f210d6203fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:49.417030 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572483c4-ddf7-43ee-aa33-4f210d6203fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:49.426467 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572483c4-ddf7-43ee-aa33-4f210d6203fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:49.438875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572483c4-ddf7-43ee-aa33-4f210d6203fc service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:49.439397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0751871ed30466eab6ec48cfbbe3b44', 'request_id': 'req-2c5c276b-0973-416d-9e61-8db870d373e7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:49.447291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0751871ed30466eab6ec48cfbbe3b44', 'request_id': 'req-2c5c276b-0973-416d-9e61-8db870d373e7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:49.462815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1334/2671] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:38:49.511178 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0751871ed30466eab6ec48cfbbe3b44', 'request_id': 'req-2c5c276b-0973-416d-9e61-8db870d373e7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:49.530108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] The token cache is being invalidate because project e0751871ed30466eab6ec48cfbbe3b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:49.530660 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:49.532839 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:49.535645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1338/2672] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:49 2022] DELETE /identity/v3/projects/e0751871ed30466eab6ec48cfbbe3b44 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:49.540123 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572483c4-ddf7-43ee-aa33-4f210d6203fc service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:49.559030 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572483c4-ddf7-43ee-aa33-4f210d6203fc service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:49.652821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af703fbd-a063-4043-9cf1-ddb145efd3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:49.653911 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af703fbd-a063-4043-9cf1-ddb145efd3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:49.654197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af703fbd-a063-4043-9cf1-ddb145efd3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:49.654479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af703fbd-a063-4043-9cf1-ddb145efd3e5 admin admin] PATH_INFO: `/v3/users/9812c931cbb1450f8517a9baf7e98c88` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:49.656549 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af703fbd-a063-4043-9cf1-ddb145efd3e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9812c931cbb1450f8517a9baf7e98c88)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:49.658696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af703fbd-a063-4043-9cf1-ddb145efd3e5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:49.845872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-af703fbd-a063-4043-9cf1-ddb145efd3e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9812c931cbb1450f8517a9baf7e98c88'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:49.857991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-af703fbd-a063-4043-9cf1-ddb145efd3e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9812c931cbb1450f8517a9baf7e98c88'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:49.865006 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-af703fbd-a063-4043-9cf1-ddb145efd3e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9812c931cbb1450f8517a9baf7e98c88'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:49.866242 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-af703fbd-a063-4043-9cf1-ddb145efd3e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9812c931cbb1450f8517a9baf7e98c88'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:49.953016 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-af703fbd-a063-4043-9cf1-ddb145efd3e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9812c931cbb1450f8517a9baf7e98c88'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:49.960620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1335/2673] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:49 2022] DELETE /identity/v3/users/9812c931cbb1450f8517a9baf7e98c88 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:50.583257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:50.585657 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:50.601164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c276b-0973-416d-9e61-8db870d373e7 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:50.679032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:50.679971 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:50.680320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:50.680661 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] PATH_INFO: `/v3/projects/34b0432f2d2941c3bb3dca84cb3bfc86` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:50.681975 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b0432f2d2941c3bb3dca84cb3bfc86)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:50.684083 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:50.777050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b0432f2d2941c3bb3dca84cb3bfc86', 'request_id': 'req-5c350b09-02b7-4d9b-b981-70fb097d4e54'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:50.782425 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b0432f2d2941c3bb3dca84cb3bfc86', 'request_id': 'req-5c350b09-02b7-4d9b-b981-70fb097d4e54'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:50.820863 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b0432f2d2941c3bb3dca84cb3bfc86', 'request_id': 'req-5c350b09-02b7-4d9b-b981-70fb097d4e54'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:50.832997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] The token cache is being invalidate because project 34b0432f2d2941c3bb3dca84cb3bfc86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:50.833285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:50.833935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-5c350b09-02b7-4d9b-b981-70fb097d4e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:50.836389 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1339/2674] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:50 2022] DELETE /identity/v3/projects/34b0432f2d2941c3bb3dca84cb3bfc86 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:50.841188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613a7cd-ee7f-4562-acb1-5a6916bd47ff None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:50.841676 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613a7cd-ee7f-4562-acb1-5a6916bd47ff None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:50.841789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613a7cd-ee7f-4562-acb1-5a6916bd47ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:50.879731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f613a7cd-ee7f-4562-acb1-5a6916bd47ff None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:50.880964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f613a7cd-ee7f-4562-acb1-5a6916bd47ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:50.940852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1336/2675] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:50.948956 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336bcf-2cfb-4f81-ac2d-adf1ddedc30e None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:50.949254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336bcf-2cfb-4f81-ac2d-adf1ddedc30e None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:50.949542 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336bcf-2cfb-4f81-ac2d-adf1ddedc30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:50.969573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-70336bcf-2cfb-4f81-ac2d-adf1ddedc30e None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:50.970792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-70336bcf-2cfb-4f81-ac2d-adf1ddedc30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:50.979234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1340/2676] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:50.983945 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613a7cd-ee7f-4562-acb1-5a6916bd47ff None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:50.999266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613a7cd-ee7f-4562-acb1-5a6916bd47ff None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:51.013108 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d5749-4cfd-4c36-a07e-bca9acc57873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:51.013791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5749-4cfd-4c36-a07e-bca9acc57873 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:51.014102 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5749-4cfd-4c36-a07e-bca9acc57873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:51.014886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5749-4cfd-4c36-a07e-bca9acc57873 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:51.015673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d5749-4cfd-4c36-a07e-bca9acc57873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:38:51.015977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d5749-4cfd-4c36-a07e-bca9acc57873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:51.017616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d5749-4cfd-4c36-a07e-bca9acc57873 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:51.033300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1337/2677] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:38:51.037942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70336bcf-2cfb-4f81-ac2d-adf1ddedc30e None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:51.055433 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70336bcf-2cfb-4f81-ac2d-adf1ddedc30e None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:51.064784 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24347ec-f467-4b3a-a781-e69d67caaba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:51.065897 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24347ec-f467-4b3a-a781-e69d67caaba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:51.066156 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24347ec-f467-4b3a-a781-e69d67caaba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:51.066509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24347ec-f467-4b3a-a781-e69d67caaba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:51.067373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24347ec-f467-4b3a-a781-e69d67caaba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:51.069991 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24347ec-f467-4b3a-a781-e69d67caaba1 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:51.213164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1341/2678] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:51 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:51.214345 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d5749-4cfd-4c36-a07e-bca9acc57873 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:51.224913 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d5749-4cfd-4c36-a07e-bca9acc57873 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:51.282398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994526c3-5430-40c6-b4af-bbe1e9b5c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:51.283173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994526c3-5430-40c6-b4af-bbe1e9b5c371 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:51.283469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994526c3-5430-40c6-b4af-bbe1e9b5c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:51.283751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994526c3-5430-40c6-b4af-bbe1e9b5c371 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:51.284467 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994526c3-5430-40c6-b4af-bbe1e9b5c371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:51.286420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994526c3-5430-40c6-b4af-bbe1e9b5c371 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:51.376636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1338/2679] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:51 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:38:51.380473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24347ec-f467-4b3a-a781-e69d67caaba1 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:51.392841 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24347ec-f467-4b3a-a781-e69d67caaba1 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:51.399525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd9f1e-317a-464a-bd20-bcd68c88b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:51.400380 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd9f1e-317a-464a-bd20-bcd68c88b3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:51.400788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd9f1e-317a-464a-bd20-bcd68c88b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:51.401136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd9f1e-317a-464a-bd20-bcd68c88b3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:51.401941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd9f1e-317a-464a-bd20-bcd68c88b3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:51.403742 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd9f1e-317a-464a-bd20-bcd68c88b3fd admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:51.419752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1342/2680] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:51.421647 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994526c3-5430-40c6-b4af-bbe1e9b5c371 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:51.432125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994526c3-5430-40c6-b4af-bbe1e9b5c371 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:51.436993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf809835-65a1-4536-a177-fd653c641ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:51.437670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf809835-65a1-4536-a177-fd653c641ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:51.437966 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf809835-65a1-4536-a177-fd653c641ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:51.438252 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf809835-65a1-4536-a177-fd653c641ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:51.439572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf809835-65a1-4536-a177-fd653c641ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:51.443482 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf809835-65a1-4536-a177-fd653c641ae5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:51.461764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1339/2681] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:51.466582 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd9f1e-317a-464a-bd20-bcd68c88b3fd admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:51.478604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd9f1e-317a-464a-bd20-bcd68c88b3fd admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:51.486783 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aed82-7794-40b9-aaeb-c44b043346f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:51.487730 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aed82-7794-40b9-aaeb-c44b043346f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:51.488012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aed82-7794-40b9-aaeb-c44b043346f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:51.488287 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aed82-7794-40b9-aaeb-c44b043346f7 admin admin] PATH_INFO: `/v3/projects/594c1e684125419cb71d8225b2ffd85b/users/06ed66ea2d4a464e87c03254ae53218f/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:51.510740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aed82-7794-40b9-aaeb-c44b043346f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594c1e684125419cb71d8225b2ffd85b, user_id=06ed66ea2d4a464e87c03254ae53218f, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:51.513697 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aed82-7794-40b9-aaeb-c44b043346f7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:51.582189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1343/2682] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:51 2022] PUT /identity/v3/projects/594c1e684125419cb71d8225b2ffd85b/users/06ed66ea2d4a464e87c03254ae53218f/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:51.594285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734c04-f9f6-4d1b-ad2d-12ac97880940 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:51.594550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734c04-f9f6-4d1b-ad2d-12ac97880940 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:51.595044 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734c04-f9f6-4d1b-ad2d-12ac97880940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:51.628363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-76734c04-f9f6-4d1b-ad2d-12ac97880940 None None] MFA Rules not processed for user `06ed66ea2d4a464e87c03254ae53218f`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:51.630716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-76734c04-f9f6-4d1b-ad2d-12ac97880940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:51.703198 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1340/2683] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:51.707898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aed82-7794-40b9-aaeb-c44b043346f7 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:51.780943 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aed82-7794-40b9-aaeb-c44b043346f7 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:51.785785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff16fd-a876-4455-bddc-810e6038d0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:51.786453 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff16fd-a876-4455-bddc-810e6038d0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:51.786736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff16fd-a876-4455-bddc-810e6038d0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:51.787013 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff16fd-a876-4455-bddc-810e6038d0f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:51.787814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff16fd-a876-4455-bddc-810e6038d0f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:51.789761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff16fd-a876-4455-bddc-810e6038d0f4 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:51.869324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1344/2684] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:51 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:38:51.873726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76734c04-f9f6-4d1b-ad2d-12ac97880940 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:51.885124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76734c04-f9f6-4d1b-ad2d-12ac97880940 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:51.947806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d6e4c-bcfa-4a06-b6b2-c5b38a933cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:51.948539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d6e4c-bcfa-4a06-b6b2-c5b38a933cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:51.948784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d6e4c-bcfa-4a06-b6b2-c5b38a933cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:51.949053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d6e4c-bcfa-4a06-b6b2-c5b38a933cbd admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:51.949818 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d6e4c-bcfa-4a06-b6b2-c5b38a933cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:51.951807 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d6e4c-bcfa-4a06-b6b2-c5b38a933cbd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:52.072215 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1341/2685] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:51 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:38:52.073991 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff16fd-a876-4455-bddc-810e6038d0f4 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:52.077740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fcff16fd-a876-4455-bddc-810e6038d0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:52.081985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d6e4c-bcfa-4a06-b6b2-c5b38a933cbd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:52.093529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d6e4c-bcfa-4a06-b6b2-c5b38a933cbd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:52.099118 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8626f1-5c10-4e4b-a4ed-1d14510c1cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:52.099964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8626f1-5c10-4e4b-a4ed-1d14510c1cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:52.100189 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8626f1-5c10-4e4b-a4ed-1d14510c1cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:52.100656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8626f1-5c10-4e4b-a4ed-1d14510c1cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:52.101699 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8626f1-5c10-4e4b-a4ed-1d14510c1cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:52.103434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8626f1-5c10-4e4b-a4ed-1d14510c1cd9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:52.114579 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1342/2686] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:52.118586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff16fd-a876-4455-bddc-810e6038d0f4 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:52.119550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8626f1-5c10-4e4b-a4ed-1d14510c1cd9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:52.124359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5a901-058f-4fb2-9973-88fcd7ba0259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:52.124359 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5a901-058f-4fb2-9973-88fcd7ba0259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:52.124688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5a901-058f-4fb2-9973-88fcd7ba0259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:52.124894 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5a901-058f-4fb2-9973-88fcd7ba0259 admin admin] PATH_INFO: `/v3/users/57f36ff6dbd24787baf10788bdf8a1f4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:52.126103 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5a901-058f-4fb2-9973-88fcd7ba0259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f36ff6dbd24787baf10788bdf8a1f4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:52.128088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5a901-058f-4fb2-9973-88fcd7ba0259 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:52.129449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8626f1-5c10-4e4b-a4ed-1d14510c1cd9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:52.141183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c94425-a8cb-4f07-929e-da0a1db8fbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:52.141904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c94425-a8cb-4f07-929e-da0a1db8fbf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:52.142182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c94425-a8cb-4f07-929e-da0a1db8fbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:52.142459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c94425-a8cb-4f07-929e-da0a1db8fbf1 admin admin] PATH_INFO: `/v3/projects/75a7798b4d364a629b68071682c1fec9/users/b214a10339754be2a5fb448f4227aadf/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:52.159681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c94425-a8cb-4f07-929e-da0a1db8fbf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a7798b4d364a629b68071682c1fec9, user_id=b214a10339754be2a5fb448f4227aadf, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:52.162409 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c94425-a8cb-4f07-929e-da0a1db8fbf1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:52.278553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1343/2687] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:52 2022] PUT /identity/v3/projects/75a7798b4d364a629b68071682c1fec9/users/b214a10339754be2a5fb448f4227aadf/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:52.282333 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c94425-a8cb-4f07-929e-da0a1db8fbf1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:52.315147 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-09c5a901-058f-4fb2-9973-88fcd7ba0259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f36ff6dbd24787baf10788bdf8a1f4'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.327459 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-09c5a901-058f-4fb2-9973-88fcd7ba0259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f36ff6dbd24787baf10788bdf8a1f4'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.328212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-09c5a901-058f-4fb2-9973-88fcd7ba0259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f36ff6dbd24787baf10788bdf8a1f4'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.342607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c94425-a8cb-4f07-929e-da0a1db8fbf1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:52.347388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5f32b-aec6-4869-a16b-f0f348d8f8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:52.348161 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5f32b-aec6-4869-a16b-f0f348d8f8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:52.348449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5f32b-aec6-4869-a16b-f0f348d8f8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:52.348729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5f32b-aec6-4869-a16b-f0f348d8f8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:52.349455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5f32b-aec6-4869-a16b-f0f348d8f8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:52.351672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5f32b-aec6-4869-a16b-f0f348d8f8d1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:52.361447 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1344/2688] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:38:52.365609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5f32b-aec6-4869-a16b-f0f348d8f8d1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:52.374950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-09c5a901-058f-4fb2-9973-88fcd7ba0259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f36ff6dbd24787baf10788bdf8a1f4'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.375423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5f32b-aec6-4869-a16b-f0f348d8f8d1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:52.380111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9da0-9940-4129-a481-20de47d8d6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:52.380949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9da0-9940-4129-a481-20de47d8d6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:52.381227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9da0-9940-4129-a481-20de47d8d6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:52.381499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9da0-9940-4129-a481-20de47d8d6dc admin admin] PATH_INFO: `/v3/projects/75a7798b4d364a629b68071682c1fec9/users/b214a10339754be2a5fb448f4227aadf/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:52.382120 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-09c5a901-058f-4fb2-9973-88fcd7ba0259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f36ff6dbd24787baf10788bdf8a1f4'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.383543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9da0-9940-4129-a481-20de47d8d6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a7798b4d364a629b68071682c1fec9, user_id=b214a10339754be2a5fb448f4227aadf, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:52.388213 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9da0-9940-4129-a481-20de47d8d6dc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:52.388513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1345/2689] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:52 2022] DELETE /identity/v3/users/57f36ff6dbd24787baf10788bdf8a1f4 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:52.398383 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1345/2690] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:52 2022] PUT /identity/v3/projects/75a7798b4d364a629b68071682c1fec9/users/b214a10339754be2a5fb448f4227aadf/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:52.408481 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228779be-158a-4d8a-9f88-77dccb9432d3 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:52.408776 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228779be-158a-4d8a-9f88-77dccb9432d3 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:52.409055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228779be-158a-4d8a-9f88-77dccb9432d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:52.437607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-228779be-158a-4d8a-9f88-77dccb9432d3 None None] MFA Rules not processed for user `b214a10339754be2a5fb448f4227aadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:52.438824 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-228779be-158a-4d8a-9f88-77dccb9432d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:52.506895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1346/2691] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:52.517837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9da0-9940-4129-a481-20de47d8d6dc admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:52.519559 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-057b9da0-9940-4129-a481-20de47d8d6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:52.577536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9da0-9940-4129-a481-20de47d8d6dc admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:52.583371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed51ec-a916-499f-b1cf-b02ecf9ae779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:52.583371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed51ec-a916-499f-b1cf-b02ecf9ae779 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:52.583371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed51ec-a916-499f-b1cf-b02ecf9ae779 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:52.583371 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed51ec-a916-499f-b1cf-b02ecf9ae779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:52.592799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed51ec-a916-499f-b1cf-b02ecf9ae779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:52.594134 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228779be-158a-4d8a-9f88-77dccb9432d3 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:52.594432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed51ec-a916-499f-b1cf-b02ecf9ae779 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:52.595554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-228779be-158a-4d8a-9f88-77dccb9432d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:52.605275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1346/2692] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:52.652491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed51ec-a916-499f-b1cf-b02ecf9ae779 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:52.653573 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6aed51ec-a916-499f-b1cf-b02ecf9ae779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:52.670089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228779be-158a-4d8a-9f88-77dccb9432d3 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:52.671879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed51ec-a916-499f-b1cf-b02ecf9ae779 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:52.676476 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:52.680613 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c4551-1283-42d4-be66-376126ad2bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:52.680991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:52.680991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:52.680991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] PATH_INFO: `/v3/projects/6c34f44042ac43cc8a6a7937c0683120` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:52.681264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4551-1283-42d4-be66-376126ad2bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:52.681264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4551-1283-42d4-be66-376126ad2bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:52.681264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4551-1283-42d4-be66-376126ad2bd2 admin admin] PATH_INFO: `/v3/users/db2dd8757a284c2484538e288e214c80` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:52.681523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c34f44042ac43cc8a6a7937c0683120)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:52.681624 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c4551-1283-42d4-be66-376126ad2bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2dd8757a284c2484538e288e214c80)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:52.681739 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:52.684101 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c4551-1283-42d4-be66-376126ad2bd2 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:52.793662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c34f44042ac43cc8a6a7937c0683120', 'request_id': 'req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.799308 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c34f44042ac43cc8a6a7937c0683120', 'request_id': 'req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.851672 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-773c4551-1283-42d4-be66-376126ad2bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2dd8757a284c2484538e288e214c80'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.855368 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c34f44042ac43cc8a6a7937c0683120', 'request_id': 'req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.863872 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-773c4551-1283-42d4-be66-376126ad2bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2dd8757a284c2484538e288e214c80'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.864585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-773c4551-1283-42d4-be66-376126ad2bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2dd8757a284c2484538e288e214c80'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.866868 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] The token cache is being invalidate because project 6c34f44042ac43cc8a6a7937c0683120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:52.867183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.867815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.869466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1347/2693] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:52 2022] DELETE /identity/v3/projects/6c34f44042ac43cc8a6a7937c0683120 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:52.873382 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:52.874693 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:52.916615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-773c4551-1283-42d4-be66-376126ad2bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2dd8757a284c2484538e288e214c80'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.924086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-773c4551-1283-42d4-be66-376126ad2bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2dd8757a284c2484538e288e214c80'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:52.930207 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1347/2694] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:38:52 2022] DELETE /identity/v3/users/db2dd8757a284c2484538e288e214c80 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:52.933120 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf7e70-06a5-4e34-bc01-95e6c51b8b8c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:52.933246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6407630-f8dc-4ecf-bd1d-14c2ddc0de23 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:52.933246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6407630-f8dc-4ecf-bd1d-14c2ddc0de23 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:52.933246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6407630-f8dc-4ecf-bd1d-14c2ddc0de23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:52.950898 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e6407630-f8dc-4ecf-bd1d-14c2ddc0de23 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:52.952200 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e6407630-f8dc-4ecf-bd1d-14c2ddc0de23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:52.983734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facf955-057b-4e7d-834a-ca8662d846d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:52.984404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facf955-057b-4e7d-834a-ca8662d846d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:52.984681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facf955-057b-4e7d-834a-ca8662d846d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:52.984955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facf955-057b-4e7d-834a-ca8662d846d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:52.986820 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3facf955-057b-4e7d-834a-ca8662d846d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:53.016174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1348/2695] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:53.017891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb07c6-7ab6-43c3-aa0b-391548484816 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.018197 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb07c6-7ab6-43c3-aa0b-391548484816 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.018480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb07c6-7ab6-43c3-aa0b-391548484816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.040920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-73eb07c6-7ab6-43c3-aa0b-391548484816 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:53.042189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-73eb07c6-7ab6-43c3-aa0b-391548484816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:53.050813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1349/2696] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:53.052017 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f1c76-1382-4d50-b39a-ba008081d3d9 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.052375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f1c76-1382-4d50-b39a-ba008081d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.052782 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f1c76-1382-4d50-b39a-ba008081d3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.060119 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facf955-057b-4e7d-834a-ca8662d846d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:53.061753 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facf955-057b-4e7d-834a-ca8662d846d0 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:53.072562 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1348/2697] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:53.072861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-e10f1c76-1382-4d50-b39a-ba008081d3d9 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:53.073628 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facf955-057b-4e7d-834a-ca8662d846d0 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:53.074199 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e10f1c76-1382-4d50-b39a-ba008081d3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:53.075444 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3facf955-057b-4e7d-834a-ca8662d846d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:53.083384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1350/2698] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:53.088086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f1c76-1382-4d50-b39a-ba008081d3d9 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:53.098058 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f1c76-1382-4d50-b39a-ba008081d3d9 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:53.103255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06b2ee-467e-46d2-9800-c6dc8d21da4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:53.103980 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b2ee-467e-46d2-9800-c6dc8d21da4a admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.104292 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b2ee-467e-46d2-9800-c6dc8d21da4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.104573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b2ee-467e-46d2-9800-c6dc8d21da4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.105569 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06b2ee-467e-46d2-9800-c6dc8d21da4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:38:53.105875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06b2ee-467e-46d2-9800-c6dc8d21da4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:53.107566 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06b2ee-467e-46d2-9800-c6dc8d21da4a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:53.119619 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1351/2699] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:38:53.123801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06b2ee-467e-46d2-9800-c6dc8d21da4a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:53.136790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06b2ee-467e-46d2-9800-c6dc8d21da4a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:53.138927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facf955-057b-4e7d-834a-ca8662d846d0 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:53.142035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dfa8d-3701-4516-af04-1171a00f30c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:53.142700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dfa8d-3701-4516-af04-1171a00f30c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.142991 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dfa8d-3701-4516-af04-1171a00f30c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.143311 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dfa8d-3701-4516-af04-1171a00f30c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.143933 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59626a8-575d-4a38-94fd-02da21601217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:53.144098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dfa8d-3701-4516-af04-1171a00f30c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:53.144589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59626a8-575d-4a38-94fd-02da21601217 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.144873 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59626a8-575d-4a38-94fd-02da21601217 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.145150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59626a8-575d-4a38-94fd-02da21601217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.145921 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dfa8d-3701-4516-af04-1171a00f30c8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:53.156379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59626a8-575d-4a38-94fd-02da21601217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:53.158298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59626a8-575d-4a38-94fd-02da21601217 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:53.168272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1349/2700] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:38:53.253161 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1352/2701] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:53 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:38:53.257552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59626a8-575d-4a38-94fd-02da21601217 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:53.267946 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59626a8-575d-4a38-94fd-02da21601217 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:53.333180 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bdc45-947b-4a48-b726-7b31cc355c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:53.334056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bdc45-947b-4a48-b726-7b31cc355c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.334442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bdc45-947b-4a48-b726-7b31cc355c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.334731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bdc45-947b-4a48-b726-7b31cc355c2b admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.335512 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bdc45-947b-4a48-b726-7b31cc355c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:53.337557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bdc45-947b-4a48-b726-7b31cc355c2b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:53.444670 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1350/2702] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:53 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:38:53.449341 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dfa8d-3701-4516-af04-1171a00f30c8 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:53.459422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dfa8d-3701-4516-af04-1171a00f30c8 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:53.465343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf88ac-51de-43c2-9684-41227c948388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:53.465343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf88ac-51de-43c2-9684-41227c948388 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.465343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf88ac-51de-43c2-9684-41227c948388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.465719 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf88ac-51de-43c2-9684-41227c948388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.466394 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf88ac-51de-43c2-9684-41227c948388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:53.468093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf88ac-51de-43c2-9684-41227c948388 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:53.482962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1353/2703] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:38:53.483881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bdc45-947b-4a48-b726-7b31cc355c2b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:53.495456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bdc45-947b-4a48-b726-7b31cc355c2b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:53.500314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b561e6-bce6-4110-b2f8-40ff0f65908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:53.500980 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b561e6-bce6-4110-b2f8-40ff0f65908a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.501264 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b561e6-bce6-4110-b2f8-40ff0f65908a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.501545 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b561e6-bce6-4110-b2f8-40ff0f65908a admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.502286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b561e6-bce6-4110-b2f8-40ff0f65908a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:53.504075 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b561e6-bce6-4110-b2f8-40ff0f65908a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:53.518125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1351/2704] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:38:53.519511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf88ac-51de-43c2-9684-41227c948388 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:53.529906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf88ac-51de-43c2-9684-41227c948388 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:53.534498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256f168-073d-4c94-9c5e-b89948442aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:53.535412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256f168-073d-4c94-9c5e-b89948442aca admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.537538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256f168-073d-4c94-9c5e-b89948442aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.537538 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256f168-073d-4c94-9c5e-b89948442aca admin admin] PATH_INFO: `/v3/projects/b5e56c22478d479bb0dbff8b6f634e91/users/9672be960150446db296e8e12cdac721/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.551910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256f168-073d-4c94-9c5e-b89948442aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e56c22478d479bb0dbff8b6f634e91, user_id=9672be960150446db296e8e12cdac721, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:53.555212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256f168-073d-4c94-9c5e-b89948442aca admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:53.633234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b561e6-bce6-4110-b2f8-40ff0f65908a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:53.635249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c9b561e6-bce6-4110-b2f8-40ff0f65908a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:53.649558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b561e6-bce6-4110-b2f8-40ff0f65908a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:53.656785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1354/2705] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:53 2022] PUT /identity/v3/projects/b5e56c22478d479bb0dbff8b6f634e91/users/9672be960150446db296e8e12cdac721/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:53.667154 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e154-99eb-43d0-bd45-8fe10a7cd53c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.667449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e154-99eb-43d0-bd45-8fe10a7cd53c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.667730 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e154-99eb-43d0-bd45-8fe10a7cd53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.693371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-fb38e154-99eb-43d0-bd45-8fe10a7cd53c None None] MFA Rules not processed for user `9672be960150446db296e8e12cdac721`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:53.694616 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fb38e154-99eb-43d0-bd45-8fe10a7cd53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:53.715684 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:53.716589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.716872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.717145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] PATH_INFO: `/v3/projects/88f7defdcc1d481583e29665df3e5a00` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.718355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f7defdcc1d481583e29665df3e5a00)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:53.720361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:53.763791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1355/2706] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:38:53.768172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38e154-99eb-43d0-bd45-8fe10a7cd53c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:53.779092 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38e154-99eb-43d0-bd45-8fe10a7cd53c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:53.783761 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9274-1b94-43a4-b12f-f8da8cf1423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:53.789384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9274-1b94-43a4-b12f-f8da8cf1423b admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.789384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9274-1b94-43a4-b12f-f8da8cf1423b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.789384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9274-1b94-43a4-b12f-f8da8cf1423b admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.789384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc9274-1b94-43a4-b12f-f8da8cf1423b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:53.789384 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc9274-1b94-43a4-b12f-f8da8cf1423b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:53.849003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f7defdcc1d481583e29665df3e5a00', 'request_id': 'req-29b42ee4-4acb-4f65-b992-92c500f428e1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:53.855584 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f7defdcc1d481583e29665df3e5a00', 'request_id': 'req-29b42ee4-4acb-4f65-b992-92c500f428e1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:53.863158 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1356/2707] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:53 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:38:53.867038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9274-1b94-43a4-b12f-f8da8cf1423b admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:53.926651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9274-1b94-43a4-b12f-f8da8cf1423b admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:53.931410 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb69a0-e206-4ee4-b02d-360a701ce8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:53.932132 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb69a0-e206-4ee4-b02d-360a701ce8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.932348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb69a0-e206-4ee4-b02d-360a701ce8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.932758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb69a0-e206-4ee4-b02d-360a701ce8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.933314 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb69a0-e206-4ee4-b02d-360a701ce8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:53.935273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb69a0-e206-4ee4-b02d-360a701ce8e6 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:53.940989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f7defdcc1d481583e29665df3e5a00', 'request_id': 'req-29b42ee4-4acb-4f65-b992-92c500f428e1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:53.953920 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] The token cache is being invalidate because project 88f7defdcc1d481583e29665df3e5a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:38:53.954206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:53.954864 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-29b42ee4-4acb-4f65-b992-92c500f428e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:38:53.956471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1352/2708] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:38:53 2022] DELETE /identity/v3/projects/88f7defdcc1d481583e29665df3e5a00 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:53.961318 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a34ca-51a8-4200-ad3d-9daaaa855228 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.961608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a34ca-51a8-4200-ad3d-9daaaa855228 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.961916 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a34ca-51a8-4200-ad3d-9daaaa855228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:53.979163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1c4a34ca-51a8-4200-ad3d-9daaaa855228 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:53.980662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1c4a34ca-51a8-4200-ad3d-9daaaa855228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:53.992357 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1353/2709] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:38:53.996729 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b840e-93a2-466e-87a9-6d6f0f331874 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:53.997036 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b840e-93a2-466e-87a9-6d6f0f331874 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:53.997281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b840e-93a2-466e-87a9-6d6f0f331874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.015819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3c1b840e-93a2-466e-87a9-6d6f0f331874 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:54.017126 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3c1b840e-93a2-466e-87a9-6d6f0f331874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:54.019920 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1357/2710] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:53 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:38:54.023658 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb69a0-e206-4ee4-b02d-360a701ce8e6 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.025259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ebfb69a0-e206-4ee4-b02d-360a701ce8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:54.028394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1354/2711] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:38:54.029285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b840e-93a2-466e-87a9-6d6f0f331874 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.037493 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb69a0-e206-4ee4-b02d-360a701ce8e6 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.037968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b840e-93a2-466e-87a9-6d6f0f331874 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.042257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30998f18-e373-42cd-9a0e-35257bdbb449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.042596 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290ba14-19ac-4691-a44b-d2821e6ea23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.042917 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30998f18-e373-42cd-9a0e-35257bdbb449 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.043247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30998f18-e373-42cd-9a0e-35257bdbb449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.043361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290ba14-19ac-4691-a44b-d2821e6ea23e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.043534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290ba14-19ac-4691-a44b-d2821e6ea23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.052823 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30998f18-e373-42cd-9a0e-35257bdbb449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.052949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290ba14-19ac-4691-a44b-d2821e6ea23e admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.053071 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30998f18-e373-42cd-9a0e-35257bdbb449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.053171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290ba14-19ac-4691-a44b-d2821e6ea23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:38:54.053171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290ba14-19ac-4691-a44b-d2821e6ea23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.053361 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30998f18-e373-42cd-9a0e-35257bdbb449 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.053457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290ba14-19ac-4691-a44b-d2821e6ea23e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.056835 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1358/2712] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:38:54.059163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1355/2713] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:38:54.062422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30998f18-e373-42cd-9a0e-35257bdbb449 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.062574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290ba14-19ac-4691-a44b-d2821e6ea23e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.072597 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290ba14-19ac-4691-a44b-d2821e6ea23e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.072967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30998f18-e373-42cd-9a0e-35257bdbb449 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.077195 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de7180-b39a-4fb3-87c4-13c82136ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.077578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f21a2-6122-4829-b0b0-5c8468b94492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.077834 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7180-b39a-4fb3-87c4-13c82136ad47 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.078117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7180-b39a-4fb3-87c4-13c82136ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.078393 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7180-b39a-4fb3-87c4-13c82136ad47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.078498 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f21a2-6122-4829-b0b0-5c8468b94492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.078710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f21a2-6122-4829-b0b0-5c8468b94492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.078982 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f21a2-6122-4829-b0b0-5c8468b94492 admin admin] PATH_INFO: `/v3/projects/828ef2b3568d43b983a508f2ce52eca4/users/851a11935d1d4cdfb924d20ce33cd3d1/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.079085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de7180-b39a-4fb3-87c4-13c82136ad47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.081018 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de7180-b39a-4fb3-87c4-13c82136ad47 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.093825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f21a2-6122-4829-b0b0-5c8468b94492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828ef2b3568d43b983a508f2ce52eca4, user_id=851a11935d1d4cdfb924d20ce33cd3d1, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.096602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f21a2-6122-4829-b0b0-5c8468b94492 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.188411 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1356/2714] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:38:54 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:38:54.192514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de7180-b39a-4fb3-87c4-13c82136ad47 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.199020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1359/2715] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:54 2022] PUT /identity/v3/projects/828ef2b3568d43b983a508f2ce52eca4/users/851a11935d1d4cdfb924d20ce33cd3d1/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:54.202973 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f21a2-6122-4829-b0b0-5c8468b94492 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.252656 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de7180-b39a-4fb3-87c4-13c82136ad47 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.263412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f21a2-6122-4829-b0b0-5c8468b94492 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.267997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ad202-67e2-48ea-966c-6bb66f0acbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.268655 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ad202-67e2-48ea-966c-6bb66f0acbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.268945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ad202-67e2-48ea-966c-6bb66f0acbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.269223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ad202-67e2-48ea-966c-6bb66f0acbe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.269945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ad202-67e2-48ea-966c-6bb66f0acbe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.271585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ad202-67e2-48ea-966c-6bb66f0acbe0 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.281008 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1360/2716] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:38:54.285413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ad202-67e2-48ea-966c-6bb66f0acbe0 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.295310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ad202-67e2-48ea-966c-6bb66f0acbe0 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.299987 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8396f-bf1a-4d89-9c00-9b84c259a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.300849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8396f-bf1a-4d89-9c00-9b84c259a722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.301136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8396f-bf1a-4d89-9c00-9b84c259a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.301413 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8396f-bf1a-4d89-9c00-9b84c259a722 admin admin] PATH_INFO: `/v3/projects/828ef2b3568d43b983a508f2ce52eca4/users/851a11935d1d4cdfb924d20ce33cd3d1/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.303568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8396f-bf1a-4d89-9c00-9b84c259a722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828ef2b3568d43b983a508f2ce52eca4, user_id=851a11935d1d4cdfb924d20ce33cd3d1, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.306633 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224414b-9298-4d1e-bb1f-4a863bdbec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.306778 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8396f-bf1a-4d89-9c00-9b84c259a722 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.307327 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224414b-9298-4d1e-bb1f-4a863bdbec14 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.307611 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224414b-9298-4d1e-bb1f-4a863bdbec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.307889 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224414b-9298-4d1e-bb1f-4a863bdbec14 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.308574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224414b-9298-4d1e-bb1f-4a863bdbec14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.310539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224414b-9298-4d1e-bb1f-4a863bdbec14 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.316791 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1361/2717] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:54 2022] PUT /identity/v3/projects/828ef2b3568d43b983a508f2ce52eca4/users/851a11935d1d4cdfb924d20ce33cd3d1/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:38:54.328922 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301930db-7970-40be-83f0-1255f3232d17 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.333333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301930db-7970-40be-83f0-1255f3232d17 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.333333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301930db-7970-40be-83f0-1255f3232d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.355547 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-301930db-7970-40be-83f0-1255f3232d17 None None] MFA Rules not processed for user `851a11935d1d4cdfb924d20ce33cd3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:54.356741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-301930db-7970-40be-83f0-1255f3232d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:54.419003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1357/2718] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:38:54 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:38:54.420087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224414b-9298-4d1e-bb1f-4a863bdbec14 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.421966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1362/2719] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:38:54.431112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224414b-9298-4d1e-bb1f-4a863bdbec14 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.437309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301930db-7970-40be-83f0-1255f3232d17 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.438855 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-301930db-7970-40be-83f0-1255f3232d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:54.494033 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49880d65-6e24-42f4-96f4-26cb5a789b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.494713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49880d65-6e24-42f4-96f4-26cb5a789b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.494999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49880d65-6e24-42f4-96f4-26cb5a789b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.495312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49880d65-6e24-42f4-96f4-26cb5a789b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.496293 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49880d65-6e24-42f4-96f4-26cb5a789b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.498113 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49880d65-6e24-42f4-96f4-26cb5a789b9a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.506457 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301930db-7970-40be-83f0-1255f3232d17 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.508785 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1358/2720] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:38:54.510483 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e200709-5a4f-49a1-a27a-29579c2f69d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.511234 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e200709-5a4f-49a1-a27a-29579c2f69d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.511860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e200709-5a4f-49a1-a27a-29579c2f69d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.512214 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e200709-5a4f-49a1-a27a-29579c2f69d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.512744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49880d65-6e24-42f4-96f4-26cb5a789b9a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.522062 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e200709-5a4f-49a1-a27a-29579c2f69d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.522897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49880d65-6e24-42f4-96f4-26cb5a789b9a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.524062 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e200709-5a4f-49a1-a27a-29579c2f69d0 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.529299 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01878775-e744-4442-a8ce-3f5686dd46ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.529969 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01878775-e744-4442-a8ce-3f5686dd46ec admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.530252 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01878775-e744-4442-a8ce-3f5686dd46ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.530671 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01878775-e744-4442-a8ce-3f5686dd46ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.531449 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01878775-e744-4442-a8ce-3f5686dd46ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.534456 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1363/2721] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:38:54.536858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01878775-e744-4442-a8ce-3f5686dd46ec admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.549192 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1359/2722] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:38:54.553429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e200709-5a4f-49a1-a27a-29579c2f69d0 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.564939 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e200709-5a4f-49a1-a27a-29579c2f69d0 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.569335 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befd968-bfbb-4d08-a754-82385f5faceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.570253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befd968-bfbb-4d08-a754-82385f5faceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.570540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befd968-bfbb-4d08-a754-82385f5faceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.570824 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befd968-bfbb-4d08-a754-82385f5faceb admin admin] PATH_INFO: `/v3/projects/cf5c75273a644bef89d4c14cca60d806/users/13260f7d5dba41b5afe9b43df405ec74/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.585710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befd968-bfbb-4d08-a754-82385f5faceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5c75273a644bef89d4c14cca60d806, user_id=13260f7d5dba41b5afe9b43df405ec74, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.588438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befd968-bfbb-4d08-a754-82385f5faceb admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.673244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1364/2723] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:38:54 2022] PUT /identity/v3/projects/cf5c75273a644bef89d4c14cca60d806/users/13260f7d5dba41b5afe9b43df405ec74/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:38:54.684361 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff69c65-31a9-4b20-945b-b382160169ca None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.684649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff69c65-31a9-4b20-945b-b382160169ca None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.684923 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff69c65-31a9-4b20-945b-b382160169ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.711700 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befd968-bfbb-4d08-a754-82385f5faceb admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.713620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8ff69c65-31a9-4b20-945b-b382160169ca None None] MFA Rules not processed for user `13260f7d5dba41b5afe9b43df405ec74`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:38:54.714855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8ff69c65-31a9-4b20-945b-b382160169ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:54.767886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befd968-bfbb-4d08-a754-82385f5faceb admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.771939 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad93f4-fdeb-48bf-b455-7bfb152752ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.772587 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad93f4-fdeb-48bf-b455-7bfb152752ee service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.773414 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad93f4-fdeb-48bf-b455-7bfb152752ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.773706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad93f4-fdeb-48bf-b455-7bfb152752ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.775561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-38ad93f4-fdeb-48bf-b455-7bfb152752ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:54.778227 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1360/2724] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:38:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:38:54.790546 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff69c65-31a9-4b20-945b-b382160169ca None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:38:54.791924 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8ff69c65-31a9-4b20-945b-b382160169ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:38:54.803759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff69c65-31a9-4b20-945b-b382160169ca None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:38:54.807776 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a7de0-ab29-4dca-afe6-83c4b68f1c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:38:54.808531 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7de0-ab29-4dca-afe6-83c4b68f1c38 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:38:54.808829 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7de0-ab29-4dca-afe6-83c4b68f1c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:38:54.809080 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7de0-ab29-4dca-afe6-83c4b68f1c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:38:54.817734 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a7de0-ab29-4dca-afe6-83c4b68f1c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.821741 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a7de0-ab29-4dca-afe6-83c4b68f1c38 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.827995 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1361/2725] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:38:54.837990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad93f4-fdeb-48bf-b455-7bfb152752ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:38:54.837990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad93f4-fdeb-48bf-b455-7bfb152752ee service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:38:54.846055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1365/2726] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:38:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 17:39:00.012955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a7de0-ab29-4dca-afe6-83c4b68f1c38 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:00.014425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f03a7de0-ab29-4dca-afe6-83c4b68f1c38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:00.079910 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a7de0-ab29-4dca-afe6-83c4b68f1c38 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:00.084777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:00.085675 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:00.085961 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:00.086237 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] PATH_INFO: `/v3/users/06ed66ea2d4a464e87c03254ae53218f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:00.087517 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ed66ea2d4a464e87c03254ae53218f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:00.089478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:00.261511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ed66ea2d4a464e87c03254ae53218f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:00.272872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ed66ea2d4a464e87c03254ae53218f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:00.279461 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ed66ea2d4a464e87c03254ae53218f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:00.280320 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ed66ea2d4a464e87c03254ae53218f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:00.339607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ed66ea2d4a464e87c03254ae53218f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:00.346014 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1362/2727] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:39:00 2022] DELETE /identity/v3/users/06ed66ea2d4a464e87c03254ae53218f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:39:00.350724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9dd4-7d1c-43eb-b642-fa0526353121 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:00.351775 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9dd4-7d1c-43eb-b642-fa0526353121 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:00.352094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9dd4-7d1c-43eb-b642-fa0526353121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:00.371187 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-150b9dd4-7d1c-43eb-b642-fa0526353121 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:00.372452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-150b9dd4-7d1c-43eb-b642-fa0526353121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:00.431835 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1366/2728] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:00.442279 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:00.443740 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:00.500214 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbb45d-443a-4421-b4bc-bdda1011580c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:00.503841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e56c52-8c5c-4477-a098-5b68bcf8de42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:00.504556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e56c52-8c5c-4477-a098-5b68bcf8de42 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:00.504839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e56c52-8c5c-4477-a098-5b68bcf8de42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:00.505134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e56c52-8c5c-4477-a098-5b68bcf8de42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:00.523727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e56c52-8c5c-4477-a098-5b68bcf8de42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:00.523727 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e56c52-8c5c-4477-a098-5b68bcf8de42 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:00.526515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1363/2729] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:39:00.931215 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b9dd4-7d1c-43eb-b642-fa0526353121 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:00.932953 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-150b9dd4-7d1c-43eb-b642-fa0526353121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:00.947249 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b9dd4-7d1c-43eb-b642-fa0526353121 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:00.953108 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:00.953981 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:00.954261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:00.954526 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] PATH_INFO: `/v3/projects/594c1e684125419cb71d8225b2ffd85b` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:00.955755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594c1e684125419cb71d8225b2ffd85b)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:00.957781 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:01.078177 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594c1e684125419cb71d8225b2ffd85b', 'request_id': 'req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:01.083606 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594c1e684125419cb71d8225b2ffd85b', 'request_id': 'req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:01.163497 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594c1e684125419cb71d8225b2ffd85b', 'request_id': 'req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:01.175574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] The token cache is being invalidate because project 594c1e684125419cb71d8225b2ffd85b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:39:01.175896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:01.176525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:01.178066 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1367/2730] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:39:00 2022] DELETE /identity/v3/projects/594c1e684125419cb71d8225b2ffd85b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:39:01.182037 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e56c52-8c5c-4477-a098-5b68bcf8de42 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:01.191460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e56c52-8c5c-4477-a098-5b68bcf8de42 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:01.246908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e36b2-fa7a-463c-906a-d97c984870a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:01.247824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e36b2-fa7a-463c-906a-d97c984870a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:01.248111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e36b2-fa7a-463c-906a-d97c984870a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:01.248387 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e36b2-fa7a-463c-906a-d97c984870a4 admin admin] PATH_INFO: `/v3/users/b214a10339754be2a5fb448f4227aadf` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:01.249587 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e36b2-fa7a-463c-906a-d97c984870a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b214a10339754be2a5fb448f4227aadf)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:01.251572 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e36b2-fa7a-463c-906a-d97c984870a4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:01.416272 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-013e36b2-fa7a-463c-906a-d97c984870a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b214a10339754be2a5fb448f4227aadf'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:01.427437 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-013e36b2-fa7a-463c-906a-d97c984870a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b214a10339754be2a5fb448f4227aadf'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:01.433981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-013e36b2-fa7a-463c-906a-d97c984870a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b214a10339754be2a5fb448f4227aadf'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:01.434651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-013e36b2-fa7a-463c-906a-d97c984870a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b214a10339754be2a5fb448f4227aadf'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:01.478473 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-013e36b2-fa7a-463c-906a-d97c984870a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b214a10339754be2a5fb448f4227aadf'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:01.485188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1364/2731] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:39:01 2022] DELETE /identity/v3/users/b214a10339754be2a5fb448f4227aadf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:39:01.849688 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:01.851814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:01.864709 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea278d8-a171-47cc-a2f5-ffb87d5e6f07 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:01.940382 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:01.941587 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:01.941587 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:01.941875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] PATH_INFO: `/v3/projects/75a7798b4d364a629b68071682c1fec9` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:01.943086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a7798b4d364a629b68071682c1fec9)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:01.945667 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:02.084379 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a7798b4d364a629b68071682c1fec9', 'request_id': 'req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:02.090430 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a7798b4d364a629b68071682c1fec9', 'request_id': 'req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:02.150840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a7798b4d364a629b68071682c1fec9', 'request_id': 'req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:02.162471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] The token cache is being invalidate because project 75a7798b4d364a629b68071682c1fec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:39:02.162758 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:02.163417 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-2990a813-8f3c-4b91-a93b-8d3a8bbb7bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:02.164965 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1368/2732] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:39:01 2022] DELETE /identity/v3/projects/75a7798b4d364a629b68071682c1fec9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:39:02.171471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b358f75-3ac4-4c36-b0d2-8c1104d57032 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:02.171760 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b358f75-3ac4-4c36-b0d2-8c1104d57032 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:02.172038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b358f75-3ac4-4c36-b0d2-8c1104d57032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:02.189976 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1b358f75-3ac4-4c36-b0d2-8c1104d57032 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:02.191211 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1b358f75-3ac4-4c36-b0d2-8c1104d57032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:02.261561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1365/2733] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:02.269805 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957783d1-97b8-4dec-a70d-56c9c8f7a1e7 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:02.270094 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957783d1-97b8-4dec-a70d-56c9c8f7a1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:02.270373 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957783d1-97b8-4dec-a70d-56c9c8f7a1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:02.287858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-957783d1-97b8-4dec-a70d-56c9c8f7a1e7 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:02.289052 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-957783d1-97b8-4dec-a70d-56c9c8f7a1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:02.297596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1369/2734] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:02.301690 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b358f75-3ac4-4c36-b0d2-8c1104d57032 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:02.311817 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b358f75-3ac4-4c36-b0d2-8c1104d57032 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:02.316330 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c0822-43c8-4143-bdfc-6f7ccc924baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:02.316977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c0822-43c8-4143-bdfc-6f7ccc924baa admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:02.317258 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c0822-43c8-4143-bdfc-6f7ccc924baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:02.317553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c0822-43c8-4143-bdfc-6f7ccc924baa admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:02.318256 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c0822-43c8-4143-bdfc-6f7ccc924baa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:39:02.318563 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c0822-43c8-4143-bdfc-6f7ccc924baa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:02.320806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c0822-43c8-4143-bdfc-6f7ccc924baa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:02.331871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1366/2735] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:39:02.336358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957783d1-97b8-4dec-a70d-56c9c8f7a1e7 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:02.345243 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957783d1-97b8-4dec-a70d-56c9c8f7a1e7 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:02.349813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97b91d-7c65-4840-bec1-519cc9b45a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:02.350465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97b91d-7c65-4840-bec1-519cc9b45a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:02.350748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97b91d-7c65-4840-bec1-519cc9b45a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:02.351073 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97b91d-7c65-4840-bec1-519cc9b45a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:02.352318 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97b91d-7c65-4840-bec1-519cc9b45a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:02.354225 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97b91d-7c65-4840-bec1-519cc9b45a89 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:02.439043 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1370/2736] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:39:02 2022] POST /identity/v3/projects => generated 357 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:39:02.443146 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c0822-43c8-4143-bdfc-6f7ccc924baa admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:02.452883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c0822-43c8-4143-bdfc-6f7ccc924baa admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:02.507176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4ce69-5e11-4419-8448-57c754a8c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:02.507847 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4ce69-5e11-4419-8448-57c754a8c132 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:02.508133 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4ce69-5e11-4419-8448-57c754a8c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:02.508415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4ce69-5e11-4419-8448-57c754a8c132 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:02.509097 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4ce69-5e11-4419-8448-57c754a8c132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:02.511041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4ce69-5e11-4419-8448-57c754a8c132 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:02.592397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1367/2737] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:39:02 2022] POST /identity/v3/users => generated 279 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:39:02.596412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97b91d-7c65-4840-bec1-519cc9b45a89 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:02.607683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97b91d-7c65-4840-bec1-519cc9b45a89 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:02.612578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62e897-00da-4144-897d-89d9ac1a30e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:02.613228 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62e897-00da-4144-897d-89d9ac1a30e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:02.613518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62e897-00da-4144-897d-89d9ac1a30e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:02.613802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62e897-00da-4144-897d-89d9ac1a30e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:02.614615 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62e897-00da-4144-897d-89d9ac1a30e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:02.616273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62e897-00da-4144-897d-89d9ac1a30e2 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:02.626726 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1371/2738] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:39:02.630722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4ce69-5e11-4419-8448-57c754a8c132 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:02.641534 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4ce69-5e11-4419-8448-57c754a8c132 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:02.649297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380f538-ad48-453e-bcba-1fc2380223ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:02.649956 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380f538-ad48-453e-bcba-1fc2380223ca admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:02.650234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380f538-ad48-453e-bcba-1fc2380223ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:02.650508 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380f538-ad48-453e-bcba-1fc2380223ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:02.651257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380f538-ad48-453e-bcba-1fc2380223ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:02.652932 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380f538-ad48-453e-bcba-1fc2380223ca admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:02.664529 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1368/2739] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:39:02.668554 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62e897-00da-4144-897d-89d9ac1a30e2 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:02.678406 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62e897-00da-4144-897d-89d9ac1a30e2 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:02.683162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1ba4-7a07-45d9-abc1-6aa0e00f7ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:02.684035 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1ba4-7a07-45d9-abc1-6aa0e00f7ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:02.684320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1ba4-7a07-45d9-abc1-6aa0e00f7ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:02.684598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1ba4-7a07-45d9-abc1-6aa0e00f7ff7 admin admin] PATH_INFO: `/v3/projects/7ac193792092421981a1b709e8f250d3/users/b3e856ad980d4db085137ece04d01de6/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:02.699600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b1ba4-7a07-45d9-abc1-6aa0e00f7ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac193792092421981a1b709e8f250d3, user_id=b3e856ad980d4db085137ece04d01de6, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:02.702202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b1ba4-7a07-45d9-abc1-6aa0e00f7ff7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:02.809802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1372/2740] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:39:02 2022] PUT /identity/v3/projects/7ac193792092421981a1b709e8f250d3/users/b3e856ad980d4db085137ece04d01de6/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:39:02.821215 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05663af4-8bbc-455c-b826-85dca98933b9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:02.824451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05663af4-8bbc-455c-b826-85dca98933b9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:02.824451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05663af4-8bbc-455c-b826-85dca98933b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:02.848979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-05663af4-8bbc-455c-b826-85dca98933b9 None None] MFA Rules not processed for user `b3e856ad980d4db085137ece04d01de6`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:02.850183 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-05663af4-8bbc-455c-b826-85dca98933b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:02.911435 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1369/2741] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:02 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:02.943256 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1ba4-7a07-45d9-abc1-6aa0e00f7ff7 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:02.945654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-e49b1ba4-7a07-45d9-abc1-6aa0e00f7ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:03.002034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1ba4-7a07-45d9-abc1-6aa0e00f7ff7 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:03.005834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bb31a-160e-4cec-a3d0-659908c4f7a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:03.006478 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bb31a-160e-4cec-a3d0-659908c4f7a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:03.006765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bb31a-160e-4cec-a3d0-659908c4f7a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:03.007046 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bb31a-160e-4cec-a3d0-659908c4f7a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:03.015850 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bb31a-160e-4cec-a3d0-659908c4f7a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:03.017422 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bb31a-160e-4cec-a3d0-659908c4f7a8 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:03.026269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1373/2742] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:39:02 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:39:03.040072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05663af4-8bbc-455c-b826-85dca98933b9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:03.101078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05663af4-8bbc-455c-b826-85dca98933b9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:03.105878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:03.106741 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:03.107038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:03.107340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] PATH_INFO: `/v3/users/b3e856ad980d4db085137ece04d01de6` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:03.108553 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e856ad980d4db085137ece04d01de6)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:03.110494 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:03.319457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e856ad980d4db085137ece04d01de6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:03.330818 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e856ad980d4db085137ece04d01de6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:03.338421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e856ad980d4db085137ece04d01de6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:03.339200 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e856ad980d4db085137ece04d01de6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:03.398544 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e856ad980d4db085137ece04d01de6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:03.404824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1370/2743] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:39:03 2022] DELETE /identity/v3/users/b3e856ad980d4db085137ece04d01de6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:39:03.409445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006c3db-a7b3-4242-8ce1-394ecce58267 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:03.409792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006c3db-a7b3-4242-8ce1-394ecce58267 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:03.410086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006c3db-a7b3-4242-8ce1-394ecce58267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:03.426882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-7006c3db-a7b3-4242-8ce1-394ecce58267 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:03.428123 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7006c3db-a7b3-4242-8ce1-394ecce58267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:03.493212 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1374/2744] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:03.502986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:03.504536 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:03.565791 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3337e-bf5a-4b4b-a569-cb9c71e4634e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:03.569412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8b7c4-eb80-4719-a551-f94a1eda14ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:03.570599 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b7c4-eb80-4719-a551-f94a1eda14ec service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:03.570884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b7c4-eb80-4719-a551-f94a1eda14ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:03.571178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b7c4-eb80-4719-a551-f94a1eda14ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:03.580390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8b7c4-eb80-4719-a551-f94a1eda14ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:03.581942 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8b7c4-eb80-4719-a551-f94a1eda14ec service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:03.592131 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1371/2745] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:39:04.114994 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006c3db-a7b3-4242-8ce1-394ecce58267 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:04.117861 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-7006c3db-a7b3-4242-8ce1-394ecce58267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:04.132126 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006c3db-a7b3-4242-8ce1-394ecce58267 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:04.137870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:04.138905 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:04.139450 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:04.139838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] PATH_INFO: `/v3/projects/7ac193792092421981a1b709e8f250d3` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:04.141364 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac193792092421981a1b709e8f250d3)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:04.143536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:04.277948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac193792092421981a1b709e8f250d3', 'request_id': 'req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:04.283271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac193792092421981a1b709e8f250d3', 'request_id': 'req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:04.351468 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac193792092421981a1b709e8f250d3', 'request_id': 'req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:04.366511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] The token cache is being invalidate because project 7ac193792092421981a1b709e8f250d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:39:04.366511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:04.366511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b460968c-4ac0-463c-ad2c-f29e70e0bfd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:04.370448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1375/2746] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:39:04 2022] DELETE /identity/v3/projects/7ac193792092421981a1b709e8f250d3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:39:04.371985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfdc7f-5d42-46ed-b8aa-1a3332393062 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:04.372443 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfdc7f-5d42-46ed-b8aa-1a3332393062 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:04.372638 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfdc7f-5d42-46ed-b8aa-1a3332393062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:04.399839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-43dfdc7f-5d42-46ed-b8aa-1a3332393062 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:04.401058 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-43dfdc7f-5d42-46ed-b8aa-1a3332393062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:04.462044 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1372/2747] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:04.469728 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b746c-e36f-4d60-bdd8-6674150e2a17 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:04.470024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b746c-e36f-4d60-bdd8-6674150e2a17 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:04.470307 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b746c-e36f-4d60-bdd8-6674150e2a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:04.489813 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-741b746c-e36f-4d60-bdd8-6674150e2a17 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:04.491023 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-741b746c-e36f-4d60-bdd8-6674150e2a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:04.500005 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1376/2748] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:04.504226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfdc7f-5d42-46ed-b8aa-1a3332393062 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:04.513715 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfdc7f-5d42-46ed-b8aa-1a3332393062 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:04.518755 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11405544-0b9d-49e2-ab14-e3e8dc6c60cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:04.521297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11405544-0b9d-49e2-ab14-e3e8dc6c60cf admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:04.521297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11405544-0b9d-49e2-ab14-e3e8dc6c60cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:04.521297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11405544-0b9d-49e2-ab14-e3e8dc6c60cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:04.521297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11405544-0b9d-49e2-ab14-e3e8dc6c60cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:39:04.521297 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11405544-0b9d-49e2-ab14-e3e8dc6c60cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:04.522757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11405544-0b9d-49e2-ab14-e3e8dc6c60cf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:04.534897 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1373/2749] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 17:39:04.539721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b746c-e36f-4d60-bdd8-6674150e2a17 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:04.549141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b746c-e36f-4d60-bdd8-6674150e2a17 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:04.554968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394ac3-4690-4276-be59-fcf24dae3f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:04.555651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394ac3-4690-4276-be59-fcf24dae3f1c admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:04.555934 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394ac3-4690-4276-be59-fcf24dae3f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:04.556209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394ac3-4690-4276-be59-fcf24dae3f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:04.556915 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26394ac3-4690-4276-be59-fcf24dae3f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:04.558849 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26394ac3-4690-4276-be59-fcf24dae3f1c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:04.628480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1377/2750] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:39:04 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:39:04.632617 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11405544-0b9d-49e2-ab14-e3e8dc6c60cf admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:04.642469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11405544-0b9d-49e2-ab14-e3e8dc6c60cf admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:04.698260 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8437f9-5913-473d-a4e8-c7f440800b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:04.698959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8437f9-5913-473d-a4e8-c7f440800b1d admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:04.699317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8437f9-5913-473d-a4e8-c7f440800b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:04.699631 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8437f9-5913-473d-a4e8-c7f440800b1d admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:04.700302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8437f9-5913-473d-a4e8-c7f440800b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:04.702292 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8437f9-5913-473d-a4e8-c7f440800b1d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:04.764602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1374/2751] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:39:04 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:39:04.768446 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394ac3-4690-4276-be59-fcf24dae3f1c admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:04.779259 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394ac3-4690-4276-be59-fcf24dae3f1c admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:04.784222 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7727581-9978-4f30-a67e-19b160e2cbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:04.784890 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727581-9978-4f30-a67e-19b160e2cbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:04.785173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727581-9978-4f30-a67e-19b160e2cbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:04.785482 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727581-9978-4f30-a67e-19b160e2cbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:04.786246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7727581-9978-4f30-a67e-19b160e2cbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:04.787889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7727581-9978-4f30-a67e-19b160e2cbd9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:04.803345 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1378/2752] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:39:04.807767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8437f9-5913-473d-a4e8-c7f440800b1d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:04.818092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8437f9-5913-473d-a4e8-c7f440800b1d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:04.822757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c890-e846-4b86-adda-6d9ced504b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:04.823470 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c890-e846-4b86-adda-6d9ced504b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:04.823762 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c890-e846-4b86-adda-6d9ced504b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:04.824081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c890-e846-4b86-adda-6d9ced504b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:04.824854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c890-e846-4b86-adda-6d9ced504b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:04.826488 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c890-e846-4b86-adda-6d9ced504b30 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:04.839811 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1375/2753] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:39:04.842999 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7727581-9978-4f30-a67e-19b160e2cbd9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:04.854003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7727581-9978-4f30-a67e-19b160e2cbd9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:04.859230 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475cd97-9540-401f-9670-881bf31491ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:04.860155 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cd97-9540-401f-9670-881bf31491ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:04.860437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cd97-9540-401f-9670-881bf31491ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:04.860710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cd97-9540-401f-9670-881bf31491ec admin admin] PATH_INFO: `/v3/projects/8821012e4fde43eaa34801b1ff9c69ea/users/91850119797a4aeb836e852d33659e26/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:04.875862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475cd97-9540-401f-9670-881bf31491ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8821012e4fde43eaa34801b1ff9c69ea, user_id=91850119797a4aeb836e852d33659e26, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:04.878536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475cd97-9540-401f-9670-881bf31491ec admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:04.979724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1379/2754] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:39:04 2022] PUT /identity/v3/projects/8821012e4fde43eaa34801b1ff9c69ea/users/91850119797a4aeb836e852d33659e26/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:39:04.990096 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e54e-27ca-47d0-a738-3dadd80a1bfb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:04.990386 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e54e-27ca-47d0-a738-3dadd80a1bfb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:04.990663 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e54e-27ca-47d0-a738-3dadd80a1bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:05.017109 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1b60e54e-27ca-47d0-a738-3dadd80a1bfb None None] MFA Rules not processed for user `91850119797a4aeb836e852d33659e26`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:05.018407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1b60e54e-27ca-47d0-a738-3dadd80a1bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:05.083949 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1376/2755] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:05.095034 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475cd97-9540-401f-9670-881bf31491ec admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:05.096988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-4475cd97-9540-401f-9670-881bf31491ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:05.155500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475cd97-9540-401f-9670-881bf31491ec admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:05.159318 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f86bb-57d4-40bf-b5b6-8e0f78bf3ccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:05.159966 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f86bb-57d4-40bf-b5b6-8e0f78bf3ccd service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:05.160247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f86bb-57d4-40bf-b5b6-8e0f78bf3ccd service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:05.160518 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f86bb-57d4-40bf-b5b6-8e0f78bf3ccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:05.169270 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f86bb-57d4-40bf-b5b6-8e0f78bf3ccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:05.171291 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f86bb-57d4-40bf-b5b6-8e0f78bf3ccd service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:05.181543 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1380/2756] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:39:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:39:13.489853 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60e54e-27ca-47d0-a738-3dadd80a1bfb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:13.553109 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60e54e-27ca-47d0-a738-3dadd80a1bfb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:13.559993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:13.560875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:13.561155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:13.561430 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] PATH_INFO: `/v3/users/91850119797a4aeb836e852d33659e26` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:13.562636 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91850119797a4aeb836e852d33659e26)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:13.564646 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:13.765722 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91850119797a4aeb836e852d33659e26'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:13.778815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91850119797a4aeb836e852d33659e26'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:13.786908 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91850119797a4aeb836e852d33659e26'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:13.787803 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91850119797a4aeb836e852d33659e26'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:13.849780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91850119797a4aeb836e852d33659e26'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:13.857156 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1377/2757] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:39:13 2022] DELETE /identity/v3/users/91850119797a4aeb836e852d33659e26 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:39:13.862027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76f32-2177-4760-b48d-368b960b0b74 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:13.862027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76f32-2177-4760-b48d-368b960b0b74 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:13.862606 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76f32-2177-4760-b48d-368b960b0b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:13.879012 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a2f76f32-2177-4760-b48d-368b960b0b74 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:13.880273 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a2f76f32-2177-4760-b48d-368b960b0b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:13.943294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1381/2758] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:13.955777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:13.958309 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:14.022810 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2e42c-f85f-4597-b627-5fdfbe741db2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:14.027027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223117c3-fdd4-4a7e-a78e-2f5e00e66625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:14.027720 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223117c3-fdd4-4a7e-a78e-2f5e00e66625 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:14.027999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223117c3-fdd4-4a7e-a78e-2f5e00e66625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:14.028274 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223117c3-fdd4-4a7e-a78e-2f5e00e66625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:14.040072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223117c3-fdd4-4a7e-a78e-2f5e00e66625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:14.040072 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223117c3-fdd4-4a7e-a78e-2f5e00e66625 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:14.048879 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1378/2759] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:39:14.663797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f76f32-2177-4760-b48d-368b960b0b74 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:14.663797 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a2f76f32-2177-4760-b48d-368b960b0b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:14.675002 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f76f32-2177-4760-b48d-368b960b0b74 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:14.680561 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:14.681680 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:14.682164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:14.682444 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] PATH_INFO: `/v3/projects/8821012e4fde43eaa34801b1ff9c69ea` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:14.683715 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8821012e4fde43eaa34801b1ff9c69ea)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:14.685679 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:14.828338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8821012e4fde43eaa34801b1ff9c69ea', 'request_id': 'req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:14.834179 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8821012e4fde43eaa34801b1ff9c69ea', 'request_id': 'req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:14.941249 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8821012e4fde43eaa34801b1ff9c69ea', 'request_id': 'req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:14.953021 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] The token cache is being invalidate because project 8821012e4fde43eaa34801b1ff9c69ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:39:14.953310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:14.953996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-c6fd7926-32c9-435e-aaa1-0abcdeb4bffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:14.955598 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1382/2760] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:39:14 2022] DELETE /identity/v3/projects/8821012e4fde43eaa34801b1ff9c69ea => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:39:14.961883 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c519-c9a0-4854-ba0c-cf18fc4668c3 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:14.962376 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c519-c9a0-4854-ba0c-cf18fc4668c3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:14.962486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c519-c9a0-4854-ba0c-cf18fc4668c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:14.982558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ec49c519-c9a0-4854-ba0c-cf18fc4668c3 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:14.984342 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ec49c519-c9a0-4854-ba0c-cf18fc4668c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:15.060967 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1379/2761] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:15.068645 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620c96a-1519-442d-859d-0377f8f50451 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:15.068947 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620c96a-1519-442d-859d-0377f8f50451 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:15.069239 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620c96a-1519-442d-859d-0377f8f50451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:15.088038 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-3620c96a-1519-442d-859d-0377f8f50451 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:15.089257 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3620c96a-1519-442d-859d-0377f8f50451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:15.101437 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1383/2762] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:15.102891 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49c519-c9a0-4854-ba0c-cf18fc4668c3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:15.118395 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49c519-c9a0-4854-ba0c-cf18fc4668c3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:15.123735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d595da-4b6f-4984-99b1-521c1052be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:15.126959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d595da-4b6f-4984-99b1-521c1052be3a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:15.126959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d595da-4b6f-4984-99b1-521c1052be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:15.126959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d595da-4b6f-4984-99b1-521c1052be3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:15.126959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d595da-4b6f-4984-99b1-521c1052be3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:39:15.126959 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d595da-4b6f-4984-99b1-521c1052be3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:15.127782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d595da-4b6f-4984-99b1-521c1052be3a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:15.141673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1380/2763] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:39:15.146330 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620c96a-1519-442d-859d-0377f8f50451 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:15.160162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620c96a-1519-442d-859d-0377f8f50451 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:15.165957 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2316e-ba23-40e4-b255-72831814a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:15.166717 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2316e-ba23-40e4-b255-72831814a485 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:15.167297 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2316e-ba23-40e4-b255-72831814a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:15.167470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2316e-ba23-40e4-b255-72831814a485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:15.168312 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2316e-ba23-40e4-b255-72831814a485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:15.170333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2316e-ba23-40e4-b255-72831814a485 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:15.280638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1384/2764] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:39:15 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:39:15.284640 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d595da-4b6f-4984-99b1-521c1052be3a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:15.295541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d595da-4b6f-4984-99b1-521c1052be3a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:15.354678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090865f-9067-4a0f-adf0-95eba5226d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:15.355633 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090865f-9067-4a0f-adf0-95eba5226d34 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:15.355915 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090865f-9067-4a0f-adf0-95eba5226d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:15.356186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090865f-9067-4a0f-adf0-95eba5226d34 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:15.357273 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090865f-9067-4a0f-adf0-95eba5226d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:15.358826 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090865f-9067-4a0f-adf0-95eba5226d34 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:15.445929 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1381/2765] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:39:15 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:39:15.447219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2316e-ba23-40e4-b255-72831814a485 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:15.457593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2316e-ba23-40e4-b255-72831814a485 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:15.463332 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cc91d-6d38-4fc2-8e12-9a17efca3bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:15.464177 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cc91d-6d38-4fc2-8e12-9a17efca3bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:15.464525 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cc91d-6d38-4fc2-8e12-9a17efca3bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:15.464810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cc91d-6d38-4fc2-8e12-9a17efca3bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:15.465574 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cc91d-6d38-4fc2-8e12-9a17efca3bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:15.467255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cc91d-6d38-4fc2-8e12-9a17efca3bbc admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:15.477951 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1385/2766] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:39:15.482335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090865f-9067-4a0f-adf0-95eba5226d34 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:15.492358 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090865f-9067-4a0f-adf0-95eba5226d34 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:15.497185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e3fb7-4bf8-4a8e-a17b-0e0aabcd1c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:15.501993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e3fb7-4bf8-4a8e-a17b-0e0aabcd1c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:15.501993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e3fb7-4bf8-4a8e-a17b-0e0aabcd1c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:15.501993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e3fb7-4bf8-4a8e-a17b-0e0aabcd1c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:15.501993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e3fb7-4bf8-4a8e-a17b-0e0aabcd1c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:15.501993 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e3fb7-4bf8-4a8e-a17b-0e0aabcd1c4c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:15.512310 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1382/2767] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:39:15.516450 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cc91d-6d38-4fc2-8e12-9a17efca3bbc admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:15.526941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cc91d-6d38-4fc2-8e12-9a17efca3bbc admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:15.534224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f186c-5d52-498b-86cc-767ef8d5c5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:15.534224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f186c-5d52-498b-86cc-767ef8d5c5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:15.534224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f186c-5d52-498b-86cc-767ef8d5c5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:15.534224 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f186c-5d52-498b-86cc-767ef8d5c5cd admin admin] PATH_INFO: `/v3/projects/a2baed2a25cd4112bfe8f4c1c31ebb4f/users/3845e39e590f49378bf010abf314b3fe/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:15.548848 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f186c-5d52-498b-86cc-767ef8d5c5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2baed2a25cd4112bfe8f4c1c31ebb4f, user_id=3845e39e590f49378bf010abf314b3fe, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:15.551604 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f186c-5d52-498b-86cc-767ef8d5c5cd admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:15.630940 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1386/2768] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:39:15 2022] PUT /identity/v3/projects/a2baed2a25cd4112bfe8f4c1c31ebb4f/users/3845e39e590f49378bf010abf314b3fe/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:39:15.641815 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd1a90-8e2c-48db-967c-04d96aab78c1 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:15.642109 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd1a90-8e2c-48db-967c-04d96aab78c1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:15.642390 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd1a90-8e2c-48db-967c-04d96aab78c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:15.669238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6bdd1a90-8e2c-48db-967c-04d96aab78c1 None None] MFA Rules not processed for user `3845e39e590f49378bf010abf314b3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:15.670511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6bdd1a90-8e2c-48db-967c-04d96aab78c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:15.740954 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1383/2769] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:15.747800 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f186c-5d52-498b-86cc-767ef8d5c5cd admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:15.754285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-887f186c-5d52-498b-86cc-767ef8d5c5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:15.757651 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd1a90-8e2c-48db-967c-04d96aab78c1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:15.759137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6bdd1a90-8e2c-48db-967c-04d96aab78c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:15.817824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd1a90-8e2c-48db-967c-04d96aab78c1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:15.822921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1656c4-dce8-4aa7-96a8-c5c12eacc62f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:15.823660 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1656c4-dce8-4aa7-96a8-c5c12eacc62f service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:15.823941 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1656c4-dce8-4aa7-96a8-c5c12eacc62f service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:15.824210 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1656c4-dce8-4aa7-96a8-c5c12eacc62f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:15.832867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1656c4-dce8-4aa7-96a8-c5c12eacc62f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:15.834623 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1656c4-dce8-4aa7-96a8-c5c12eacc62f service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:15.844824 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1384/2770] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:39:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:39:15.865963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f186c-5d52-498b-86cc-767ef8d5c5cd admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:15.872833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb3db3-4a62-4ec0-b4a6-7b27406a90a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:15.873488 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb3db3-4a62-4ec0-b4a6-7b27406a90a2 service nova] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:15.873771 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb3db3-4a62-4ec0-b4a6-7b27406a90a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:15.874045 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb3db3-4a62-4ec0-b4a6-7b27406a90a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:15.875906 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-01cb3db3-4a62-4ec0-b4a6-7b27406a90a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:15.889946 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb3db3-4a62-4ec0-b4a6-7b27406a90a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:15.891835 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb3db3-4a62-4ec0-b4a6-7b27406a90a2 service nova] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:15.912824 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1387/2771] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:39:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:39:29.277136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1656c4-dce8-4aa7-96a8-c5c12eacc62f service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:29.337774 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1656c4-dce8-4aa7-96a8-c5c12eacc62f service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:29.342511 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:29.343410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:29.343696 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:29.343974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] PATH_INFO: `/v3/users/3845e39e590f49378bf010abf314b3fe` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:29.345164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3845e39e590f49378bf010abf314b3fe)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:29.347117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:29.645577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3845e39e590f49378bf010abf314b3fe'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:29.656977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3845e39e590f49378bf010abf314b3fe'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:29.663617 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3845e39e590f49378bf010abf314b3fe'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:29.664282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3845e39e590f49378bf010abf314b3fe'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:29.745007 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3845e39e590f49378bf010abf314b3fe'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:29.752038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1385/2772] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:39:29 2022] DELETE /identity/v3/users/3845e39e590f49378bf010abf314b3fe => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:39:29.756564 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e6a5-8a02-4a12-85d2-81b45fa0c458 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:29.757055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e6a5-8a02-4a12-85d2-81b45fa0c458 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:29.757173 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e6a5-8a02-4a12-85d2-81b45fa0c458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:29.774588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-fdd3e6a5-8a02-4a12-85d2-81b45fa0c458 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:39:29.778180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fdd3e6a5-8a02-4a12-85d2-81b45fa0c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:29.836211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1388/2773] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:39:29.847822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:29.849471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:29.911275 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b1ed2-6e5d-418b-bfde-6533ed1ddf53 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:29.915212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d402ad-d1bb-447a-9657-dc2659261496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:29.918560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d402ad-d1bb-447a-9657-dc2659261496 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:29.918560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d402ad-d1bb-447a-9657-dc2659261496 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:29.918560 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d402ad-d1bb-447a-9657-dc2659261496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:29.926642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d402ad-d1bb-447a-9657-dc2659261496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:29.928173 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d402ad-d1bb-447a-9657-dc2659261496 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:29.938399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1386/2774] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:39:30.582687 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e6a5-8a02-4a12-85d2-81b45fa0c458 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:39:30.584174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-fdd3e6a5-8a02-4a12-85d2-81b45fa0c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:39:30.596253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e6a5-8a02-4a12-85d2-81b45fa0c458 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:39:30.601909 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:39:30.602817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:39:30.603104 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:39:30.603449 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] PATH_INFO: `/v3/projects/a2baed2a25cd4112bfe8f4c1c31ebb4f` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:39:30.606317 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2baed2a25cd4112bfe8f4c1c31ebb4f)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:39:30.611093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:39:30.716724 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2baed2a25cd4112bfe8f4c1c31ebb4f', 'request_id': 'req-7b52eb11-3989-465b-bf03-75fba996c746'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:30.722385 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2baed2a25cd4112bfe8f4c1c31ebb4f', 'request_id': 'req-7b52eb11-3989-465b-bf03-75fba996c746'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:30.784711 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2baed2a25cd4112bfe8f4c1c31ebb4f', 'request_id': 'req-7b52eb11-3989-465b-bf03-75fba996c746'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:30.797039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] The token cache is being invalidate because project a2baed2a25cd4112bfe8f4c1c31ebb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:39:30.797326 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:30.797948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-7b52eb11-3989-465b-bf03-75fba996c746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:39:30.799576 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1389/2775] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:39:30 2022] DELETE /identity/v3/projects/a2baed2a25cd4112bfe8f4c1c31ebb4f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:00.246857 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d402ad-d1bb-447a-9657-dc2659261496 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:00.253436 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f1d402ad-d1bb-447a-9657-dc2659261496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:00.260713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d402ad-d1bb-447a-9657-dc2659261496 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:00.315307 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:00.316197 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:00.316483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:00.316895 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] PATH_INFO: `/v3/users/9672be960150446db296e8e12cdac721` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:00.318869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9672be960150446db296e8e12cdac721)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:00.320876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:00.514770 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9672be960150446db296e8e12cdac721'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:00.526902 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9672be960150446db296e8e12cdac721'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:00.534101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9672be960150446db296e8e12cdac721'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:00.534774 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9672be960150446db296e8e12cdac721'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:00.621524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9672be960150446db296e8e12cdac721'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:00.628067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1387/2776] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:40:00 2022] DELETE /identity/v3/users/9672be960150446db296e8e12cdac721 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:00.632689 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e8217-b438-4233-a485-1b617f8f7e85 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:00.633190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e8217-b438-4233-a485-1b617f8f7e85 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:00.633294 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e8217-b438-4233-a485-1b617f8f7e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:00.651388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-a89e8217-b438-4233-a485-1b617f8f7e85 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:00.652589 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a89e8217-b438-4233-a485-1b617f8f7e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:00.708429 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1390/2777] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:00.718015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:00.719448 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:00.751386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e8217-b438-4233-a485-1b617f8f7e85 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:00.753101 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a89e8217-b438-4233-a485-1b617f8f7e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:00.765063 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e8217-b438-4233-a485-1b617f8f7e85 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:00.769899 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:00.770769 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:00.771048 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:00.771358 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] PATH_INFO: `/v3/users/13260f7d5dba41b5afe9b43df405ec74` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:00.772548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] RBAC: Authorizing `identity:delete_user(user_id=13260f7d5dba41b5afe9b43df405ec74)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:00.774533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:00.778771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bae6b-bdbd-4ae3-b62a-7c3841e49ffb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:00.782927 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5b5be-cf4b-4283-ba2a-4e07e67a40cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:00.783609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5b5be-cf4b-4283-ba2a-4e07e67a40cc service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:00.783896 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5b5be-cf4b-4283-ba2a-4e07e67a40cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:00.784171 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5b5be-cf4b-4283-ba2a-4e07e67a40cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:00.793064 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5b5be-cf4b-4283-ba2a-4e07e67a40cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:00.794514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5b5be-cf4b-4283-ba2a-4e07e67a40cc service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:00.804431 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1388/2778] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:40:00.966371 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13260f7d5dba41b5afe9b43df405ec74'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:00.981404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13260f7d5dba41b5afe9b43df405ec74'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:00.984147 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13260f7d5dba41b5afe9b43df405ec74'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.071962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13260f7d5dba41b5afe9b43df405ec74'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.079865 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13260f7d5dba41b5afe9b43df405ec74'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.086153 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1391/2779] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:40:00 2022] DELETE /identity/v3/users/13260f7d5dba41b5afe9b43df405ec74 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:40:01.090594 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9587-7baf-4dd1-8fc9-b6ee58002102 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:01.090888 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9587-7baf-4dd1-8fc9-b6ee58002102 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:01.091196 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9587-7baf-4dd1-8fc9-b6ee58002102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:01.109425 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-848a9587-7baf-4dd1-8fc9-b6ee58002102 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:01.110707 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-848a9587-7baf-4dd1-8fc9-b6ee58002102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:01.170249 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1389/2780] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:01.179864 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:01.181338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:01.222615 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a9587-7baf-4dd1-8fc9-b6ee58002102 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:01.224033 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-848a9587-7baf-4dd1-8fc9-b6ee58002102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:01.236404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a9587-7baf-4dd1-8fc9-b6ee58002102 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:01.239875 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f74456-25d3-4a7c-88e5-173d482c671e admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:01.241567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:01.242451 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:01.242701 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:01.242979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] PATH_INFO: `/v3/projects/b5e56c22478d479bb0dbff8b6f634e91` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:01.244097 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79290a3a-9418-41c8-b20f-125528f30599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:01.244246 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e56c22478d479bb0dbff8b6f634e91)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:01.244751 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79290a3a-9418-41c8-b20f-125528f30599 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:01.245037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79290a3a-9418-41c8-b20f-125528f30599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:01.245313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79290a3a-9418-41c8-b20f-125528f30599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:01.246191 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:01.256353 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79290a3a-9418-41c8-b20f-125528f30599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:01.257818 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79290a3a-9418-41c8-b20f-125528f30599 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:01.271040 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1392/2781] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:40:01.374306 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e56c22478d479bb0dbff8b6f634e91', 'request_id': 'req-12324abe-e3ff-4121-95f3-ea4c703b18a8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.380100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e56c22478d479bb0dbff8b6f634e91', 'request_id': 'req-12324abe-e3ff-4121-95f3-ea4c703b18a8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.455400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e56c22478d479bb0dbff8b6f634e91', 'request_id': 'req-12324abe-e3ff-4121-95f3-ea4c703b18a8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.467352 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] The token cache is being invalidate because project b5e56c22478d479bb0dbff8b6f634e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:40:01.468524 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.469653 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.474415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1390/2782] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:40:01 2022] DELETE /identity/v3/projects/b5e56c22478d479bb0dbff8b6f634e91 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:40:01.475411 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79290a3a-9418-41c8-b20f-125528f30599 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:01.485693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79290a3a-9418-41c8-b20f-125528f30599 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:01.541069 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:01.541948 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:01.542236 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:01.542513 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] PATH_INFO: `/v3/users/851a11935d1d4cdfb924d20ce33cd3d1` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:01.546780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851a11935d1d4cdfb924d20ce33cd3d1)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:01.548214 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:01.708240 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:01.710025 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:01.725332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12324abe-e3ff-4121-95f3-ea4c703b18a8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:01.731415 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:01.732310 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:01.732642 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:01.732940 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] PATH_INFO: `/v3/projects/cf5c75273a644bef89d4c14cca60d806` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:01.734141 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5c75273a644bef89d4c14cca60d806)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:01.738626 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:01.744075 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851a11935d1d4cdfb924d20ce33cd3d1'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.756536 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851a11935d1d4cdfb924d20ce33cd3d1'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.757217 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851a11935d1d4cdfb924d20ce33cd3d1'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.820777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851a11935d1d4cdfb924d20ce33cd3d1'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.827790 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851a11935d1d4cdfb924d20ce33cd3d1'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.833835 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1393/2783] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:40:01 2022] DELETE /identity/v3/users/851a11935d1d4cdfb924d20ce33cd3d1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:40:01.862434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5c75273a644bef89d4c14cca60d806', 'request_id': 'req-c17373ed-55f1-45b0-88ea-c382c93d8351'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.868056 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5c75273a644bef89d4c14cca60d806', 'request_id': 'req-c17373ed-55f1-45b0-88ea-c382c93d8351'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.941144 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5c75273a644bef89d4c14cca60d806', 'request_id': 'req-c17373ed-55f1-45b0-88ea-c382c93d8351'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.952772 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] The token cache is being invalidate because project cf5c75273a644bef89d4c14cca60d806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:40:01.953062 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.953697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c17373ed-55f1-45b0-88ea-c382c93d8351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:01.955301 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1391/2784] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:40:01 2022] DELETE /identity/v3/projects/cf5c75273a644bef89d4c14cca60d806 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:40:02.250792 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:02.252929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:02.318674 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25e516-ab4d-4725-8945-d8c6be045fa6 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:02.371651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:02.372509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:02.372817 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:02.373090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] PATH_INFO: `/v3/projects/828ef2b3568d43b983a508f2ce52eca4` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:02.374284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=828ef2b3568d43b983a508f2ce52eca4)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:02.376261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:02.516586 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828ef2b3568d43b983a508f2ce52eca4', 'request_id': 'req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:02.522309 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828ef2b3568d43b983a508f2ce52eca4', 'request_id': 'req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:02.591570 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828ef2b3568d43b983a508f2ce52eca4', 'request_id': 'req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:02.603254 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] The token cache is being invalidate because project 828ef2b3568d43b983a508f2ce52eca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:40:02.603544 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:02.604166 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-1b994ca2-e8ac-4f6b-90b4-618c181b0da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:02.605748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1394/2785] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:40:02 2022] DELETE /identity/v3/projects/828ef2b3568d43b983a508f2ce52eca4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:02.611121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fe34-1070-451f-98f6-f2a23f8b7bc8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:02.611600 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fe34-1070-451f-98f6-f2a23f8b7bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:02.611728 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fe34-1070-451f-98f6-f2a23f8b7bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:02.629558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-96c0fe34-1070-451f-98f6-f2a23f8b7bc8 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:02.630695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-96c0fe34-1070-451f-98f6-f2a23f8b7bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:02.686759 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1392/2786] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:02.694617 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d27b1-3087-473b-abe6-8c5e4198f6f6 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:02.694995 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d27b1-3087-473b-abe6-8c5e4198f6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:02.695318 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d27b1-3087-473b-abe6-8c5e4198f6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:02.713419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-2b3d27b1-3087-473b-abe6-8c5e4198f6f6 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:02.714602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2b3d27b1-3087-473b-abe6-8c5e4198f6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:02.722930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1395/2787] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:02.726965 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0fe34-1070-451f-98f6-f2a23f8b7bc8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:02.736492 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0fe34-1070-451f-98f6-f2a23f8b7bc8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:02.740979 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6424a-b185-4e23-aee2-834cec38e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:02.741620 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6424a-b185-4e23-aee2-834cec38e383 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:02.741898 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6424a-b185-4e23-aee2-834cec38e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:02.742169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6424a-b185-4e23-aee2-834cec38e383 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:02.742878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6424a-b185-4e23-aee2-834cec38e383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:40:02.743210 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6424a-b185-4e23-aee2-834cec38e383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:02.744819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6424a-b185-4e23-aee2-834cec38e383 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:02.756343 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1393/2788] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:40:02.760267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d27b1-3087-473b-abe6-8c5e4198f6f6 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:02.769945 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d27b1-3087-473b-abe6-8c5e4198f6f6 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:02.774550 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f8cb-9080-463c-8624-cb99ca04971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:02.775221 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f8cb-9080-463c-8624-cb99ca04971b admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:02.775595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f8cb-9080-463c-8624-cb99ca04971b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:02.775837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f8cb-9080-463c-8624-cb99ca04971b admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:02.776465 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326f8cb-9080-463c-8624-cb99ca04971b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:02.779248 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326f8cb-9080-463c-8624-cb99ca04971b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:02.890216 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1396/2789] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:40:02 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:40:02.894963 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6424a-b185-4e23-aee2-834cec38e383 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:02.904871 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6424a-b185-4e23-aee2-834cec38e383 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:02.959533 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ff682-8e75-4065-a2fe-db7c5b3199b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:02.960208 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ff682-8e75-4065-a2fe-db7c5b3199b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:02.960491 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ff682-8e75-4065-a2fe-db7c5b3199b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:02.960768 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ff682-8e75-4065-a2fe-db7c5b3199b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:02.961468 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ff682-8e75-4065-a2fe-db7c5b3199b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:02.963456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ff682-8e75-4065-a2fe-db7c5b3199b0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:03.072480 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1394/2790] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:40:02 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:40:03.076736 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f8cb-9080-463c-8624-cb99ca04971b admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:03.087490 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f8cb-9080-463c-8624-cb99ca04971b admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:03.092047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ed9f7-7558-43eb-aad5-037917ac3386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:03.092695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ed9f7-7558-43eb-aad5-037917ac3386 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:03.092972 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ed9f7-7558-43eb-aad5-037917ac3386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:03.093247 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ed9f7-7558-43eb-aad5-037917ac3386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:03.093994 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ed9f7-7558-43eb-aad5-037917ac3386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:03.095662 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ed9f7-7558-43eb-aad5-037917ac3386 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:03.106096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1397/2791] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 17:40:03.110134 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ff682-8e75-4065-a2fe-db7c5b3199b0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:03.120138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ff682-8e75-4065-a2fe-db7c5b3199b0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:03.124788 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dffed-ee94-411f-90f8-2e05c78d0c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:03.127406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dffed-ee94-411f-90f8-2e05c78d0c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:03.127406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dffed-ee94-411f-90f8-2e05c78d0c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:03.127406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dffed-ee94-411f-90f8-2e05c78d0c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:03.127406 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dffed-ee94-411f-90f8-2e05c78d0c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:03.128828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dffed-ee94-411f-90f8-2e05c78d0c10 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:03.138541 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1395/2792] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:03.143398 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ed9f7-7558-43eb-aad5-037917ac3386 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:03.153020 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ed9f7-7558-43eb-aad5-037917ac3386 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:03.157540 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7ef5f-27fa-4b8b-ad22-cac04c1fbb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:03.158409 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7ef5f-27fa-4b8b-ad22-cac04c1fbb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:03.158693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7ef5f-27fa-4b8b-ad22-cac04c1fbb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:03.158968 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7ef5f-27fa-4b8b-ad22-cac04c1fbb79 admin admin] PATH_INFO: `/v3/projects/d9a9fa69efef4d8587d5bec9a0bf6b28/users/787fe5469093464aa67adb3fbc1f130a/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:03.174469 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7ef5f-27fa-4b8b-ad22-cac04c1fbb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a9fa69efef4d8587d5bec9a0bf6b28, user_id=787fe5469093464aa67adb3fbc1f130a, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:03.177172 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7ef5f-27fa-4b8b-ad22-cac04c1fbb79 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:03.272651 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1398/2793] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:40:03 2022] PUT /identity/v3/projects/d9a9fa69efef4d8587d5bec9a0bf6b28/users/787fe5469093464aa67adb3fbc1f130a/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:40:03.283835 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4cc79-dada-4e71-ab0c-8ded55bfaab5 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:03.284127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4cc79-dada-4e71-ab0c-8ded55bfaab5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:03.284407 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4cc79-dada-4e71-ab0c-8ded55bfaab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:03.314493 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-71a4cc79-dada-4e71-ab0c-8ded55bfaab5 None None] MFA Rules not processed for user `787fe5469093464aa67adb3fbc1f130a`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:03.315716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-71a4cc79-dada-4e71-ab0c-8ded55bfaab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:03.375709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1396/2794] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:03.380919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7ef5f-27fa-4b8b-ad22-cac04c1fbb79 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:03.445316 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7ef5f-27fa-4b8b-ad22-cac04c1fbb79 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:03.450560 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f61f6d-dd66-4683-93c7-752667799933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:03.451262 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f61f6d-dd66-4683-93c7-752667799933 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:03.451549 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f61f6d-dd66-4683-93c7-752667799933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:03.451828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f61f6d-dd66-4683-93c7-752667799933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:03.452811 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f61f6d-dd66-4683-93c7-752667799933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:03.454597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f61f6d-dd66-4683-93c7-752667799933 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:03.539854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1399/2795] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:40:03 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:40:03.541077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4cc79-dada-4e71-ab0c-8ded55bfaab5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:03.552379 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4cc79-dada-4e71-ab0c-8ded55bfaab5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:03.606643 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce616d3-3ef0-4548-a654-d78976d1f6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:03.607332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce616d3-3ef0-4548-a654-d78976d1f6ca admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:03.607613 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce616d3-3ef0-4548-a654-d78976d1f6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:03.607884 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce616d3-3ef0-4548-a654-d78976d1f6ca admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:03.608557 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce616d3-3ef0-4548-a654-d78976d1f6ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:03.611085 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce616d3-3ef0-4548-a654-d78976d1f6ca admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:03.683744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1397/2796] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:40:03 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:40:03.688211 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f61f6d-dd66-4683-93c7-752667799933 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:03.699548 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f61f6d-dd66-4683-93c7-752667799933 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:03.705653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b7130-9bab-417a-9698-bc74bb9a727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:03.706306 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b7130-9bab-417a-9698-bc74bb9a727c admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:03.706583 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b7130-9bab-417a-9698-bc74bb9a727c admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:03.706854 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b7130-9bab-417a-9698-bc74bb9a727c admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:03.707614 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b7130-9bab-417a-9698-bc74bb9a727c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:03.710028 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b7130-9bab-417a-9698-bc74bb9a727c admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:03.720996 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1400/2797] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:03.725068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce616d3-3ef0-4548-a654-d78976d1f6ca admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:03.735091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce616d3-3ef0-4548-a654-d78976d1f6ca admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:03.740298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62036c5-9560-4b02-94e9-2af4583b137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:03.740938 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62036c5-9560-4b02-94e9-2af4583b137f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:03.741244 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62036c5-9560-4b02-94e9-2af4583b137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:03.741515 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62036c5-9560-4b02-94e9-2af4583b137f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:03.742228 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62036c5-9560-4b02-94e9-2af4583b137f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:03.743876 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62036c5-9560-4b02-94e9-2af4583b137f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:03.753486 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1398/2798] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:03.757392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b7130-9bab-417a-9698-bc74bb9a727c admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:03.766884 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b7130-9bab-417a-9698-bc74bb9a727c admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:03.771473 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3d8c3-c764-4dc7-89ae-f5a20c3ea4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:03.772338 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3d8c3-c764-4dc7-89ae-f5a20c3ea4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:03.772621 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3d8c3-c764-4dc7-89ae-f5a20c3ea4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:03.772895 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3d8c3-c764-4dc7-89ae-f5a20c3ea4b8 admin admin] PATH_INFO: `/v3/projects/cb8bc89f175b4ae184549f1246d11e59/users/d750408b7761480b97386d006f8943df/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:03.787349 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3d8c3-c764-4dc7-89ae-f5a20c3ea4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8bc89f175b4ae184549f1246d11e59, user_id=d750408b7761480b97386d006f8943df, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:03.789989 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3d8c3-c764-4dc7-89ae-f5a20c3ea4b8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:03.883276 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1401/2799] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:40:03 2022] PUT /identity/v3/projects/cb8bc89f175b4ae184549f1246d11e59/users/d750408b7761480b97386d006f8943df/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:03.893934 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b56a-c8b6-4338-a0d8-f382c4cec7aa None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:03.894332 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b56a-c8b6-4338-a0d8-f382c4cec7aa None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:03.894618 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b56a-c8b6-4338-a0d8-f382c4cec7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:03.920823 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-fae5b56a-c8b6-4338-a0d8-f382c4cec7aa None None] MFA Rules not processed for user `d750408b7761480b97386d006f8943df`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:03.922023 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fae5b56a-c8b6-4338-a0d8-f382c4cec7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:03.989458 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1399/2800] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:03.994236 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3d8c3-c764-4dc7-89ae-f5a20c3ea4b8 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:04.053695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3d8c3-c764-4dc7-89ae-f5a20c3ea4b8 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:04.058314 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfb9c3-d1cb-4d62-9bf3-52e8a28c5e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:04.058962 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfb9c3-d1cb-4d62-9bf3-52e8a28c5e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:04.059277 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfb9c3-d1cb-4d62-9bf3-52e8a28c5e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:04.059555 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfb9c3-d1cb-4d62-9bf3-52e8a28c5e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:04.060246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfb9c3-d1cb-4d62-9bf3-52e8a28c5e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:04.062151 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfb9c3-d1cb-4d62-9bf3-52e8a28c5e03 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:04.145638 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1402/2801] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:40:03 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:40:04.149717 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5b56a-c8b6-4338-a0d8-f382c4cec7aa None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:04.161008 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5b56a-c8b6-4338-a0d8-f382c4cec7aa None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:04.217875 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99290d5d-5864-40b6-9656-67cc2aff184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:04.218865 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99290d5d-5864-40b6-9656-67cc2aff184c admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:04.219397 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99290d5d-5864-40b6-9656-67cc2aff184c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:04.220421 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99290d5d-5864-40b6-9656-67cc2aff184c admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:04.221138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99290d5d-5864-40b6-9656-67cc2aff184c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:04.223194 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99290d5d-5864-40b6-9656-67cc2aff184c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:04.333412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1400/2802] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:40:04 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:40:04.334502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfb9c3-d1cb-4d62-9bf3-52e8a28c5e03 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:04.345118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfb9c3-d1cb-4d62-9bf3-52e8a28c5e03 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:04.349812 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76e19d-8c2d-4ea8-82e4-9f20aacf2750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:04.354419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76e19d-8c2d-4ea8-82e4-9f20aacf2750 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:04.354419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76e19d-8c2d-4ea8-82e4-9f20aacf2750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:04.354419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76e19d-8c2d-4ea8-82e4-9f20aacf2750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:04.354419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76e19d-8c2d-4ea8-82e4-9f20aacf2750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:04.354419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76e19d-8c2d-4ea8-82e4-9f20aacf2750 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:04.365653 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1403/2803] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:04.370744 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99290d5d-5864-40b6-9656-67cc2aff184c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:04.381748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99290d5d-5864-40b6-9656-67cc2aff184c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:04.386432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b95e5-9393-4755-9bf1-54520837bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:04.387394 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b95e5-9393-4755-9bf1-54520837bcb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:04.387688 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b95e5-9393-4755-9bf1-54520837bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:04.387966 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b95e5-9393-4755-9bf1-54520837bcb7 admin admin] PATH_INFO: `/v3/projects/1638eeb5a60c4c2eaf5e17c700b47f19/users/2c6de9c2cc9a4f8f861762c4d4d87274/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:04.405143 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b95e5-9393-4755-9bf1-54520837bcb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1638eeb5a60c4c2eaf5e17c700b47f19, user_id=2c6de9c2cc9a4f8f861762c4d4d87274, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:04.407901 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b95e5-9393-4755-9bf1-54520837bcb7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:04.480692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1401/2804] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:40:04 2022] PUT /identity/v3/projects/1638eeb5a60c4c2eaf5e17c700b47f19/users/2c6de9c2cc9a4f8f861762c4d4d87274/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:04.484814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76e19d-8c2d-4ea8-82e4-9f20aacf2750 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:04.494896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76e19d-8c2d-4ea8-82e4-9f20aacf2750 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:04.549264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3ba63-5fcc-4c12-ac0a-36a05d70a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:04.549935 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3ba63-5fcc-4c12-ac0a-36a05d70a09e admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:04.550226 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3ba63-5fcc-4c12-ac0a-36a05d70a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:04.550506 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3ba63-5fcc-4c12-ac0a-36a05d70a09e admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:04.551264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3ba63-5fcc-4c12-ac0a-36a05d70a09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:04.552868 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3ba63-5fcc-4c12-ac0a-36a05d70a09e admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:04.562283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1404/2805] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:04.567166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b95e5-9393-4755-9bf1-54520837bcb7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:04.577312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b95e5-9393-4755-9bf1-54520837bcb7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:04.582650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf384-7f40-494e-929f-8a5f066756ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:04.583558 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf384-7f40-494e-929f-8a5f066756ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:04.583841 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf384-7f40-494e-929f-8a5f066756ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:04.584110 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf384-7f40-494e-929f-8a5f066756ce admin admin] PATH_INFO: `/v3/projects/1638eeb5a60c4c2eaf5e17c700b47f19/users/2c6de9c2cc9a4f8f861762c4d4d87274/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:04.586065 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bf384-7f40-494e-929f-8a5f066756ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1638eeb5a60c4c2eaf5e17c700b47f19, user_id=2c6de9c2cc9a4f8f861762c4d4d87274, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:04.588771 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bf384-7f40-494e-929f-8a5f066756ce admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:04.598802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1402/2806] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:40:04 2022] PUT /identity/v3/projects/1638eeb5a60c4c2eaf5e17c700b47f19/users/2c6de9c2cc9a4f8f861762c4d4d87274/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:04.610141 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305ce4-4d1d-4f04-aa7c-0e7132d82994 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:04.610467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305ce4-4d1d-4f04-aa7c-0e7132d82994 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:04.610748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305ce4-4d1d-4f04-aa7c-0e7132d82994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:04.636703 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-95305ce4-4d1d-4f04-aa7c-0e7132d82994 None None] MFA Rules not processed for user `2c6de9c2cc9a4f8f861762c4d4d87274`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:04.637919 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-95305ce4-4d1d-4f04-aa7c-0e7132d82994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:04.704186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1405/2807] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:04.714986 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf384-7f40-494e-929f-8a5f066756ce admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:04.716780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-720bf384-7f40-494e-929f-8a5f066756ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:04.793402 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf384-7f40-494e-929f-8a5f066756ce admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:04.796132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d4a99-71e1-48ce-8cb4-21391ccc0b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:04.796784 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d4a99-71e1-48ce-8cb4-21391ccc0b2f service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:04.797067 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d4a99-71e1-48ce-8cb4-21391ccc0b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:04.797345 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d4a99-71e1-48ce-8cb4-21391ccc0b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:04.806678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d4a99-71e1-48ce-8cb4-21391ccc0b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:04.808168 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d4a99-71e1-48ce-8cb4-21391ccc0b2f service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:04.817896 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1403/2808] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:40:05.793515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95305ce4-4d1d-4f04-aa7c-0e7132d82994 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:05.794936 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-95305ce4-4d1d-4f04-aa7c-0e7132d82994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:05.806650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95305ce4-4d1d-4f04-aa7c-0e7132d82994 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:05.810186 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ad513-8857-41a5-9c4e-0a6fae9d8ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:05.810825 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad513-8857-41a5-9c4e-0a6fae9d8ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:05.811113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad513-8857-41a5-9c4e-0a6fae9d8ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:05.811421 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad513-8857-41a5-9c4e-0a6fae9d8ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:05.865669 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ad513-8857-41a5-9c4e-0a6fae9d8ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:05.867171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ad513-8857-41a5-9c4e-0a6fae9d8ee3 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:05.875814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1406/2809] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:40:10.741690 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d4a99-71e1-48ce-8cb4-21391ccc0b2f service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:10.750271 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d4a99-71e1-48ce-8cb4-21391ccc0b2f service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:10.754756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b5350-26b9-4a17-acc5-67ce619320ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:10.755433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b5350-26b9-4a17-acc5-67ce619320ae service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:10.755719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b5350-26b9-4a17-acc5-67ce619320ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:10.756000 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b5350-26b9-4a17-acc5-67ce619320ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:10.810731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b5350-26b9-4a17-acc5-67ce619320ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:10.812261 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b5350-26b9-4a17-acc5-67ce619320ae service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:10.822164 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1404/2810] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:40:14.629748 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ad513-8857-41a5-9c4e-0a6fae9d8ee3 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:14.689676 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ad513-8857-41a5-9c4e-0a6fae9d8ee3 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:14.694696 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:14.695593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:14.695882 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:14.696160 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] PATH_INFO: `/v3/users/787fe5469093464aa67adb3fbc1f130a` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:14.697333 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=787fe5469093464aa67adb3fbc1f130a)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:14.699320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:14.874689 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787fe5469093464aa67adb3fbc1f130a'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:14.886607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787fe5469093464aa67adb3fbc1f130a'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:14.887300 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787fe5469093464aa67adb3fbc1f130a'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:14.934654 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787fe5469093464aa67adb3fbc1f130a'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:14.942037 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787fe5469093464aa67adb3fbc1f130a'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:14.947786 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1407/2811] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:40:14 2022] DELETE /identity/v3/users/787fe5469093464aa67adb3fbc1f130a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:40:14.952442 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf5c8-6ac8-4d38-a9c8-52ef4e8f4575 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:14.952953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf5c8-6ac8-4d38-a9c8-52ef4e8f4575 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:14.953066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf5c8-6ac8-4d38-a9c8-52ef4e8f4575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:14.970777 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-edadf5c8-6ac8-4d38-a9c8-52ef4e8f4575 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:14.972013 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-edadf5c8-6ac8-4d38-a9c8-52ef4e8f4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:15.029754 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1405/2812] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:15.039472 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:15.040886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:15.097123 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8ad3f-7990-44e8-9448-a2157a40fce4 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:15.100838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3bdc2-4be5-4110-b1a0-5f2ead4e3a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:15.101480 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3bdc2-4be5-4110-b1a0-5f2ead4e3a84 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:15.101767 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3bdc2-4be5-4110-b1a0-5f2ead4e3a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:15.102047 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3bdc2-4be5-4110-b1a0-5f2ead4e3a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:15.111375 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3bdc2-4be5-4110-b1a0-5f2ead4e3a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:15.114372 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3bdc2-4be5-4110-b1a0-5f2ead4e3a84 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:15.123799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1408/2813] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:40:15.523342 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadf5c8-6ac8-4d38-a9c8-52ef4e8f4575 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:15.526363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-edadf5c8-6ac8-4d38-a9c8-52ef4e8f4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:15.536757 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadf5c8-6ac8-4d38-a9c8-52ef4e8f4575 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:15.541822 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:15.542692 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:15.542974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:15.543748 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] PATH_INFO: `/v3/projects/d9a9fa69efef4d8587d5bec9a0bf6b28` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:15.544681 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a9fa69efef4d8587d5bec9a0bf6b28)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:15.549286 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:15.641101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a9fa69efef4d8587d5bec9a0bf6b28', 'request_id': 'req-53215ebc-74c0-4365-93f3-621f503a97a3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:15.647170 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a9fa69efef4d8587d5bec9a0bf6b28', 'request_id': 'req-53215ebc-74c0-4365-93f3-621f503a97a3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:15.704015 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a9fa69efef4d8587d5bec9a0bf6b28', 'request_id': 'req-53215ebc-74c0-4365-93f3-621f503a97a3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:15.716027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] The token cache is being invalidate because project d9a9fa69efef4d8587d5bec9a0bf6b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:40:15.716312 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:15.716968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:15.718502 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1406/2814] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:40:15 2022] DELETE /identity/v3/projects/d9a9fa69efef4d8587d5bec9a0bf6b28 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:15.726519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3bdc2-4be5-4110-b1a0-5f2ead4e3a84 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:15.738096 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3bdc2-4be5-4110-b1a0-5f2ead4e3a84 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:15.794508 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:15.795403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:15.795686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:15.795959 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] PATH_INFO: `/v3/users/d750408b7761480b97386d006f8943df` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:15.797127 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d750408b7761480b97386d006f8943df)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:15.799057 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:16.033255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd750408b7761480b97386d006f8943df'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:16.047106 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd750408b7761480b97386d006f8943df'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:16.047858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd750408b7761480b97386d006f8943df'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:16.129189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd750408b7761480b97386d006f8943df'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:16.136475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd750408b7761480b97386d006f8943df'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:16.142351 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1409/2815] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:40:15 2022] DELETE /identity/v3/users/d750408b7761480b97386d006f8943df => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:16.530277 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:16.531802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:16.547528 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53215ebc-74c0-4365-93f3-621f503a97a3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:16.603658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:16.604520 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:16.604858 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:16.605150 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] PATH_INFO: `/v3/projects/cb8bc89f175b4ae184549f1246d11e59` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:16.606581 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb8bc89f175b4ae184549f1246d11e59)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:16.608550 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:16.724731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8bc89f175b4ae184549f1246d11e59', 'request_id': 'req-a6bdb84d-85b8-46c6-9798-f98434571648'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:16.730079 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8bc89f175b4ae184549f1246d11e59', 'request_id': 'req-a6bdb84d-85b8-46c6-9798-f98434571648'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:16.803059 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8bc89f175b4ae184549f1246d11e59', 'request_id': 'req-a6bdb84d-85b8-46c6-9798-f98434571648'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:16.814154 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] The token cache is being invalidate because project cb8bc89f175b4ae184549f1246d11e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:40:16.814445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:16.815101 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:16.817291 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1407/2816] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:40:16 2022] DELETE /identity/v3/projects/cb8bc89f175b4ae184549f1246d11e59 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:16.821420 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:16.822866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:16.835950 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692d243-ac7c-4e15-b5d7-60494646411b admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:16.890870 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e8dab-1335-48fb-8344-80d257c5852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:16.891770 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e8dab-1335-48fb-8344-80d257c5852d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:16.892050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e8dab-1335-48fb-8344-80d257c5852d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:16.892324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e8dab-1335-48fb-8344-80d257c5852d admin admin] PATH_INFO: `/v3/users/2c6de9c2cc9a4f8f861762c4d4d87274` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:16.893494 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e8dab-1335-48fb-8344-80d257c5852d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6de9c2cc9a4f8f861762c4d4d87274)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:16.895955 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e8dab-1335-48fb-8344-80d257c5852d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:17.131086 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-083e8dab-1335-48fb-8344-80d257c5852d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6de9c2cc9a4f8f861762c4d4d87274'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:17.142269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-083e8dab-1335-48fb-8344-80d257c5852d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6de9c2cc9a4f8f861762c4d4d87274'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:17.142928 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-083e8dab-1335-48fb-8344-80d257c5852d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6de9c2cc9a4f8f861762c4d4d87274'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:17.224487 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-083e8dab-1335-48fb-8344-80d257c5852d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6de9c2cc9a4f8f861762c4d4d87274'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:17.231939 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-083e8dab-1335-48fb-8344-80d257c5852d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6de9c2cc9a4f8f861762c4d4d87274'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:17.237777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1410/2817] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:40:16 2022] DELETE /identity/v3/users/2c6de9c2cc9a4f8f861762c4d4d87274 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:17.627685 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:17.629175 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:17.643393 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdb84d-85b8-46c6-9798-f98434571648 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:17.700609 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:17.701469 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:17.701760 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:17.702038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] PATH_INFO: `/v3/projects/1638eeb5a60c4c2eaf5e17c700b47f19` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:17.703238 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1638eeb5a60c4c2eaf5e17c700b47f19)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:17.705182 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:17.851106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1638eeb5a60c4c2eaf5e17c700b47f19', 'request_id': 'req-b1a40c32-ca16-4efa-8837-79d3601fac25'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:17.856500 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1638eeb5a60c4c2eaf5e17c700b47f19', 'request_id': 'req-b1a40c32-ca16-4efa-8837-79d3601fac25'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:17.914840 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1638eeb5a60c4c2eaf5e17c700b47f19', 'request_id': 'req-b1a40c32-ca16-4efa-8837-79d3601fac25'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:17.926049 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] The token cache is being invalidate because project 1638eeb5a60c4c2eaf5e17c700b47f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:40:17.926340 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:17.926972 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b1a40c32-ca16-4efa-8837-79d3601fac25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:17.928556 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1408/2818] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:40:17 2022] DELETE /identity/v3/projects/1638eeb5a60c4c2eaf5e17c700b47f19 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:17.934605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0bbd-1dd6-4cf3-aada-c75886479605 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:17.935080 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0bbd-1dd6-4cf3-aada-c75886479605 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:17.935218 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0bbd-1dd6-4cf3-aada-c75886479605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:17.953504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-52df0bbd-1dd6-4cf3-aada-c75886479605 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:17.954695 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-52df0bbd-1dd6-4cf3-aada-c75886479605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:18.012370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1411/2819] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:18.021344 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1574255-e835-485f-a7c7-7ef924c36693 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:18.022124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1574255-e835-485f-a7c7-7ef924c36693 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:18.022124 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1574255-e835-485f-a7c7-7ef924c36693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:18.040166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d1574255-e835-485f-a7c7-7ef924c36693 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:18.041363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d1574255-e835-485f-a7c7-7ef924c36693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:18.049234 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1409/2820] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:18.056223 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df0bbd-1dd6-4cf3-aada-c75886479605 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:18.067578 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df0bbd-1dd6-4cf3-aada-c75886479605 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:18.073930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe760ee-c1d4-4eab-a04f-985dd9cc50fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:18.074605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe760ee-c1d4-4eab-a04f-985dd9cc50fd admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:18.074889 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe760ee-c1d4-4eab-a04f-985dd9cc50fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:18.075189 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe760ee-c1d4-4eab-a04f-985dd9cc50fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:18.075929 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe760ee-c1d4-4eab-a04f-985dd9cc50fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:40:18.078069 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe760ee-c1d4-4eab-a04f-985dd9cc50fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:18.079763 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe760ee-c1d4-4eab-a04f-985dd9cc50fd admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:18.094546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1412/2821] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:40:18.101654 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1574255-e835-485f-a7c7-7ef924c36693 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:18.111149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1574255-e835-485f-a7c7-7ef924c36693 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:18.116521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc87b8-186c-4da3-9a41-1d6916e3f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:18.117172 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc87b8-186c-4da3-9a41-1d6916e3f4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:18.117489 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc87b8-186c-4da3-9a41-1d6916e3f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:18.117767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc87b8-186c-4da3-9a41-1d6916e3f4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:18.118467 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc87b8-186c-4da3-9a41-1d6916e3f4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:18.120867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc87b8-186c-4da3-9a41-1d6916e3f4b1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:18.230854 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1410/2822] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:40:18 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:40:18.235206 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe760ee-c1d4-4eab-a04f-985dd9cc50fd admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:18.245799 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe760ee-c1d4-4eab-a04f-985dd9cc50fd admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:18.299381 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8824b-41c5-469a-922f-7e9481f17ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:18.300063 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8824b-41c5-469a-922f-7e9481f17ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:18.300350 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8824b-41c5-469a-922f-7e9481f17ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:18.301113 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8824b-41c5-469a-922f-7e9481f17ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:18.301860 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8824b-41c5-469a-922f-7e9481f17ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:18.303833 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8824b-41c5-469a-922f-7e9481f17ce6 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:18.380302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1413/2823] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:40:18 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:40:18.384554 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc87b8-186c-4da3-9a41-1d6916e3f4b1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:18.395363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc87b8-186c-4da3-9a41-1d6916e3f4b1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:18.400179 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdd1e9-af1d-4cce-be52-e64b3f0ebcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:18.400837 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd1e9-af1d-4cce-be52-e64b3f0ebcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:18.401117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd1e9-af1d-4cce-be52-e64b3f0ebcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:18.401400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd1e9-af1d-4cce-be52-e64b3f0ebcc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:18.402132 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdd1e9-af1d-4cce-be52-e64b3f0ebcc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:18.403800 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdd1e9-af1d-4cce-be52-e64b3f0ebcc2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:18.415186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1411/2824] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:18.419686 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8824b-41c5-469a-922f-7e9481f17ce6 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:18.429774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8824b-41c5-469a-922f-7e9481f17ce6 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:18.434466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af9b6f-2096-4cdd-adb5-9f885d1ff90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:18.435149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9b6f-2096-4cdd-adb5-9f885d1ff90d admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:18.435443 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9b6f-2096-4cdd-adb5-9f885d1ff90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:18.435725 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9b6f-2096-4cdd-adb5-9f885d1ff90d admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:18.436466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af9b6f-2096-4cdd-adb5-9f885d1ff90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:18.438090 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af9b6f-2096-4cdd-adb5-9f885d1ff90d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:18.448343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1414/2825] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:18.452645 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdd1e9-af1d-4cce-be52-e64b3f0ebcc2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:18.462921 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdd1e9-af1d-4cce-be52-e64b3f0ebcc2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:18.467565 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbb512-009d-4d7c-a33c-cda8773857cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:18.468438 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbb512-009d-4d7c-a33c-cda8773857cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:18.468723 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbb512-009d-4d7c-a33c-cda8773857cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:18.469001 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbb512-009d-4d7c-a33c-cda8773857cf admin admin] PATH_INFO: `/v3/projects/1a0d3c70863940b7ab5d11e6e105c28c/users/4856aa479fa04302818e0843e6753441/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:18.485070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbb512-009d-4d7c-a33c-cda8773857cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0d3c70863940b7ab5d11e6e105c28c, user_id=4856aa479fa04302818e0843e6753441, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:18.487830 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbb512-009d-4d7c-a33c-cda8773857cf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:18.557904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1412/2826] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:40:18 2022] PUT /identity/v3/projects/1a0d3c70863940b7ab5d11e6e105c28c/users/4856aa479fa04302818e0843e6753441/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 17:40:18.569528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab474a02-47ac-46de-b7bd-b422d5d43733 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:18.569838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab474a02-47ac-46de-b7bd-b422d5d43733 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:18.570118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab474a02-47ac-46de-b7bd-b422d5d43733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:18.596509 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-ab474a02-47ac-46de-b7bd-b422d5d43733 None None] MFA Rules not processed for user `4856aa479fa04302818e0843e6753441`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:18.597755 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-ab474a02-47ac-46de-b7bd-b422d5d43733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:18.659423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1415/2827] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:18.664003 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbb512-009d-4d7c-a33c-cda8773857cf admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:18.723767 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbb512-009d-4d7c-a33c-cda8773857cf admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:18.728328 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95880e43-de6c-4828-9ec8-5ec6da1fa98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:18.728980 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95880e43-de6c-4828-9ec8-5ec6da1fa98d admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:18.729257 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95880e43-de6c-4828-9ec8-5ec6da1fa98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:18.729530 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95880e43-de6c-4828-9ec8-5ec6da1fa98d admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:18.730221 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95880e43-de6c-4828-9ec8-5ec6da1fa98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:18.732457 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95880e43-de6c-4828-9ec8-5ec6da1fa98d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:18.827801 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1413/2828] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:40:18 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:40:18.832031 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab474a02-47ac-46de-b7bd-b422d5d43733 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:18.843271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab474a02-47ac-46de-b7bd-b422d5d43733 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:18.897605 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f804fb-fa70-4b80-a2de-3e21487752df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:18.898263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f804fb-fa70-4b80-a2de-3e21487752df admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:18.898546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f804fb-fa70-4b80-a2de-3e21487752df admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:18.898819 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f804fb-fa70-4b80-a2de-3e21487752df admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:18.899534 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f804fb-fa70-4b80-a2de-3e21487752df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:18.901471 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f804fb-fa70-4b80-a2de-3e21487752df admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:19.010006 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1416/2829] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:40:18 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:40:19.014388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95880e43-de6c-4828-9ec8-5ec6da1fa98d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:19.024334 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95880e43-de6c-4828-9ec8-5ec6da1fa98d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:19.029143 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd56fc-20d3-4a45-b4fa-d6a152c1306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:19.029794 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd56fc-20d3-4a45-b4fa-d6a152c1306e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:19.030078 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd56fc-20d3-4a45-b4fa-d6a152c1306e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:19.030460 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd56fc-20d3-4a45-b4fa-d6a152c1306e admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:19.031229 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd56fc-20d3-4a45-b4fa-d6a152c1306e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:19.032855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd56fc-20d3-4a45-b4fa-d6a152c1306e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:19.043420 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1414/2830] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:19.047388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f804fb-fa70-4b80-a2de-3e21487752df admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:19.057777 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f804fb-fa70-4b80-a2de-3e21487752df admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:19.062881 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12fe82-6fdd-44f8-90b1-a57df4cffb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:19.063798 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12fe82-6fdd-44f8-90b1-a57df4cffb0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:19.064087 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12fe82-6fdd-44f8-90b1-a57df4cffb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:19.064366 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12fe82-6fdd-44f8-90b1-a57df4cffb0f admin admin] PATH_INFO: `/v3/projects/bb4be35460f74e3397ccd8700bd55802/users/1986955a5a604c93bd1be5400367e4b3/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:19.079528 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12fe82-6fdd-44f8-90b1-a57df4cffb0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4be35460f74e3397ccd8700bd55802, user_id=1986955a5a604c93bd1be5400367e4b3, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:19.082136 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12fe82-6fdd-44f8-90b1-a57df4cffb0f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:19.167511 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1417/2831] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:40:19 2022] PUT /identity/v3/projects/bb4be35460f74e3397ccd8700bd55802/users/1986955a5a604c93bd1be5400367e4b3/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:19.171608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd56fc-20d3-4a45-b4fa-d6a152c1306e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:19.181905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd56fc-20d3-4a45-b4fa-d6a152c1306e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:19.238764 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4f490-faed-49a3-903c-b92bd1e126f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:19.240839 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4f490-faed-49a3-903c-b92bd1e126f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:19.241127 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4f490-faed-49a3-903c-b92bd1e126f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:19.241408 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4f490-faed-49a3-903c-b92bd1e126f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:19.242130 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4f490-faed-49a3-903c-b92bd1e126f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:19.243789 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4f490-faed-49a3-903c-b92bd1e126f1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:19.253239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1415/2832] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:19.257370 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12fe82-6fdd-44f8-90b1-a57df4cffb0f admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:19.267647 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12fe82-6fdd-44f8-90b1-a57df4cffb0f admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:19.272300 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934893b3-ecae-4537-87f3-f468f1b7cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:19.273180 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934893b3-ecae-4537-87f3-f468f1b7cdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:19.273470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934893b3-ecae-4537-87f3-f468f1b7cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:19.273750 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934893b3-ecae-4537-87f3-f468f1b7cdcc admin admin] PATH_INFO: `/v3/projects/bb4be35460f74e3397ccd8700bd55802/users/1986955a5a604c93bd1be5400367e4b3/roles/2791519d9bad43318f086666b6e64a20` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:19.275757 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934893b3-ecae-4537-87f3-f468f1b7cdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4be35460f74e3397ccd8700bd55802, user_id=1986955a5a604c93bd1be5400367e4b3, role_id=2791519d9bad43318f086666b6e64a20)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:19.278403 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934893b3-ecae-4537-87f3-f468f1b7cdcc admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:19.289100 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1418/2833] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:40:19 2022] PUT /identity/v3/projects/bb4be35460f74e3397ccd8700bd55802/users/1986955a5a604c93bd1be5400367e4b3/roles/2791519d9bad43318f086666b6e64a20 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:19.299855 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e8c53-7c8b-4bf4-a5f0-da26d10bf43a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:19.300149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e8c53-7c8b-4bf4-a5f0-da26d10bf43a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:19.300428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e8c53-7c8b-4bf4-a5f0-da26d10bf43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:19.326239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c18e8c53-7c8b-4bf4-a5f0-da26d10bf43a None None] MFA Rules not processed for user `1986955a5a604c93bd1be5400367e4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:19.327479 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c18e8c53-7c8b-4bf4-a5f0-da26d10bf43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:19.392092 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1416/2834] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:19.402891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934893b3-ecae-4537-87f3-f468f1b7cdcc admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:19.404606 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-934893b3-ecae-4537-87f3-f468f1b7cdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:19.461051 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934893b3-ecae-4537-87f3-f468f1b7cdcc admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:19.464678 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710f323-e1a6-439f-922a-864071f56034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:19.465313 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710f323-e1a6-439f-922a-864071f56034 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:19.465597 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710f323-e1a6-439f-922a-864071f56034 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:19.465873 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710f323-e1a6-439f-922a-864071f56034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:19.475084 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710f323-e1a6-439f-922a-864071f56034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:19.476546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710f323-e1a6-439f-922a-864071f56034 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:19.485886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1419/2835] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:40:20.467612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e8c53-7c8b-4bf4-a5f0-da26d10bf43a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:20.527766 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e8c53-7c8b-4bf4-a5f0-da26d10bf43a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:20.532281 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:20.533149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:20.533434 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:20.533713 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] PATH_INFO: `/v3/users/4856aa479fa04302818e0843e6753441` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:20.534890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4856aa479fa04302818e0843e6753441)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:20.536869 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:20.741253 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4856aa479fa04302818e0843e6753441'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:20.754542 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4856aa479fa04302818e0843e6753441'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:20.762198 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4856aa479fa04302818e0843e6753441'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:20.762939 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4856aa479fa04302818e0843e6753441'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:20.814756 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4856aa479fa04302818e0843e6753441'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:20.821980 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1417/2836] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:40:20 2022] DELETE /identity/v3/users/4856aa479fa04302818e0843e6753441 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:20.826595 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd84514-7be8-444f-a8f8-55540b756131 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:20.827067 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd84514-7be8-444f-a8f8-55540b756131 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:20.829111 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd84514-7be8-444f-a8f8-55540b756131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:20.844264 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-3dd84514-7be8-444f-a8f8-55540b756131 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:20.845466 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3dd84514-7be8-444f-a8f8-55540b756131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:20.901632 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1420/2837] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:20.911300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:20.912716 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:20.969619 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d964b5d-c8ac-4153-9dfd-ac92ec321180 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:20.973366 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152fb0a-cdcd-41ac-aba6-54b5aa2a65f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:20.974012 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152fb0a-cdcd-41ac-aba6-54b5aa2a65f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:20.974298 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152fb0a-cdcd-41ac-aba6-54b5aa2a65f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:20.974575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152fb0a-cdcd-41ac-aba6-54b5aa2a65f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:20.983991 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152fb0a-cdcd-41ac-aba6-54b5aa2a65f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:20.985455 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152fb0a-cdcd-41ac-aba6-54b5aa2a65f0 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:20.995185 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1418/2838] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:40:21.404229 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd84514-7be8-444f-a8f8-55540b756131 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:21.405673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-3dd84514-7be8-444f-a8f8-55540b756131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:21.420519 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd84514-7be8-444f-a8f8-55540b756131 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:21.426263 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:21.427754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:21.428138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:21.428302 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] PATH_INFO: `/v3/projects/1a0d3c70863940b7ab5d11e6e105c28c` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:21.429531 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0d3c70863940b7ab5d11e6e105c28c)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:21.431502 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:21.537441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0d3c70863940b7ab5d11e6e105c28c', 'request_id': 'req-17560050-79d2-4d0b-a0c7-d023f250f8c8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:21.542754 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0d3c70863940b7ab5d11e6e105c28c', 'request_id': 'req-17560050-79d2-4d0b-a0c7-d023f250f8c8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:21.617753 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0d3c70863940b7ab5d11e6e105c28c', 'request_id': 'req-17560050-79d2-4d0b-a0c7-d023f250f8c8'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:21.628984 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] The token cache is being invalidate because project 1a0d3c70863940b7ab5d11e6e105c28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:40:21.629268 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:21.629886 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:21.631492 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1421/2839] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:40:21 2022] DELETE /identity/v3/projects/1a0d3c70863940b7ab5d11e6e105c28c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:21.635506 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152fb0a-cdcd-41ac-aba6-54b5aa2a65f0 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:21.644962 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152fb0a-cdcd-41ac-aba6-54b5aa2a65f0 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:21.699528 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4b5f5-1e1b-4761-810b-e787f9e0f909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:21.700405 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4b5f5-1e1b-4761-810b-e787f9e0f909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:21.700697 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4b5f5-1e1b-4761-810b-e787f9e0f909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:21.700977 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4b5f5-1e1b-4761-810b-e787f9e0f909 admin admin] PATH_INFO: `/v3/users/1986955a5a604c93bd1be5400367e4b3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:21.702155 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4b5f5-1e1b-4761-810b-e787f9e0f909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1986955a5a604c93bd1be5400367e4b3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:21.704136 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4b5f5-1e1b-4761-810b-e787f9e0f909 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:21.910160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-09f4b5f5-1e1b-4761-810b-e787f9e0f909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1986955a5a604c93bd1be5400367e4b3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:21.922091 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-09f4b5f5-1e1b-4761-810b-e787f9e0f909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1986955a5a604c93bd1be5400367e4b3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:21.928738 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-09f4b5f5-1e1b-4761-810b-e787f9e0f909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1986955a5a604c93bd1be5400367e4b3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:21.929412 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-09f4b5f5-1e1b-4761-810b-e787f9e0f909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1986955a5a604c93bd1be5400367e4b3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:21.972355 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-09f4b5f5-1e1b-4761-810b-e787f9e0f909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1986955a5a604c93bd1be5400367e4b3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:21.978999 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1419/2840] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:40:21 2022] DELETE /identity/v3/users/1986955a5a604c93bd1be5400367e4b3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:22.359412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:22.360963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:22.373903 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560050-79d2-4d0b-a0c7-d023f250f8c8 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:22.429851 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:22.430647 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:22.430934 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:22.431244 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] PATH_INFO: `/v3/projects/bb4be35460f74e3397ccd8700bd55802` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:22.432428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4be35460f74e3397ccd8700bd55802)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:22.434354 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:22.532233 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4be35460f74e3397ccd8700bd55802', 'request_id': 'req-4b48af13-269e-4fee-8ba3-cb7bf07c595b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:22.537593 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4be35460f74e3397ccd8700bd55802', 'request_id': 'req-4b48af13-269e-4fee-8ba3-cb7bf07c595b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:22.608805 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4be35460f74e3397ccd8700bd55802', 'request_id': 'req-4b48af13-269e-4fee-8ba3-cb7bf07c595b'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:22.620237 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] The token cache is being invalidate because project bb4be35460f74e3397ccd8700bd55802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:40:22.620526 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:22.621152 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-4b48af13-269e-4fee-8ba3-cb7bf07c595b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:22.622682 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1422/2841] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:40:22 2022] DELETE /identity/v3/projects/bb4be35460f74e3397ccd8700bd55802 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:22.628121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da08e5e-2e72-47c8-bb86-daa57f586d5f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:22.630216 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da08e5e-2e72-47c8-bb86-daa57f586d5f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:22.630216 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da08e5e-2e72-47c8-bb86-daa57f586d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:22.647323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2da08e5e-2e72-47c8-bb86-daa57f586d5f None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:22.648525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2da08e5e-2e72-47c8-bb86-daa57f586d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:22.706525 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1420/2842] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:22.713977 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db873-fcd3-4ab4-9120-5d022e074a5c None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:22.714253 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db873-fcd3-4ab4-9120-5d022e074a5c None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:22.714533 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db873-fcd3-4ab4-9120-5d022e074a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:22.732493 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-931db873-fcd3-4ab4-9120-5d022e074a5c None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:22.733693 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-931db873-fcd3-4ab4-9120-5d022e074a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:22.742053 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1423/2843] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:22.746077 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da08e5e-2e72-47c8-bb86-daa57f586d5f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:22.756215 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da08e5e-2e72-47c8-bb86-daa57f586d5f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:22.760743 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0223e7-43c5-455a-a391-5791244e1562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:22.761388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0223e7-43c5-455a-a391-5791244e1562 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:22.761672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0223e7-43c5-455a-a391-5791244e1562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:22.761950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0223e7-43c5-455a-a391-5791244e1562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:22.762673 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0223e7-43c5-455a-a391-5791244e1562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:40:22.762980 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0223e7-43c5-455a-a391-5791244e1562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:22.764650 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0223e7-43c5-455a-a391-5791244e1562 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:22.775810 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1421/2844] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:40:22.779907 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db873-fcd3-4ab4-9120-5d022e074a5c None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:22.789050 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db873-fcd3-4ab4-9120-5d022e074a5c None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:22.793752 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a35725-8996-4ba0-bbca-bf3a2242d38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:22.794397 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a35725-8996-4ba0-bbca-bf3a2242d38f admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:22.794685 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a35725-8996-4ba0-bbca-bf3a2242d38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:22.794964 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a35725-8996-4ba0-bbca-bf3a2242d38f admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:22.795698 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a35725-8996-4ba0-bbca-bf3a2242d38f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:22.797646 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a35725-8996-4ba0-bbca-bf3a2242d38f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:22.907039 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1424/2845] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:40:22 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:40:22.911612 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0223e7-43c5-455a-a391-5791244e1562 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:22.921290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0223e7-43c5-455a-a391-5791244e1562 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:22.975721 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37092e52-2a7b-411f-860e-5958d7471b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:22.976323 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37092e52-2a7b-411f-860e-5958d7471b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:22.976605 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37092e52-2a7b-411f-860e-5958d7471b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:22.976881 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37092e52-2a7b-411f-860e-5958d7471b6e admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:22.977578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37092e52-2a7b-411f-860e-5958d7471b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:22.979567 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37092e52-2a7b-411f-860e-5958d7471b6e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:23.107104 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1422/2846] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:40:22 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:40:23.110997 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a35725-8996-4ba0-bbca-bf3a2242d38f admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:23.121804 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a35725-8996-4ba0-bbca-bf3a2242d38f admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:23.126343 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327af2e4-51f0-4f33-9e1f-df22e0e06171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:23.127001 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327af2e4-51f0-4f33-9e1f-df22e0e06171 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:23.127324 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327af2e4-51f0-4f33-9e1f-df22e0e06171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:23.127608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327af2e4-51f0-4f33-9e1f-df22e0e06171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:23.128339 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327af2e4-51f0-4f33-9e1f-df22e0e06171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:23.129946 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327af2e4-51f0-4f33-9e1f-df22e0e06171 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:23.140220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1425/2847] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:23.144163 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37092e52-2a7b-411f-860e-5958d7471b6e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:23.153846 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37092e52-2a7b-411f-860e-5958d7471b6e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:23.158314 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d97e4-1e6a-4623-b5f8-284b996cbd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:23.158955 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d97e4-1e6a-4623-b5f8-284b996cbd8e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:23.159267 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d97e4-1e6a-4623-b5f8-284b996cbd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:23.159543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d97e4-1e6a-4623-b5f8-284b996cbd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:23.160254 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d97e4-1e6a-4623-b5f8-284b996cbd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:23.162432 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d97e4-1e6a-4623-b5f8-284b996cbd8e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:23.172138 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1423/2848] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:23.177099 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327af2e4-51f0-4f33-9e1f-df22e0e06171 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:23.186668 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327af2e4-51f0-4f33-9e1f-df22e0e06171 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:23.191269 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683a6f6-5075-4cc1-aee6-9197b94cbcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:23.192149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683a6f6-5075-4cc1-aee6-9197b94cbcf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:23.192428 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683a6f6-5075-4cc1-aee6-9197b94cbcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:23.192699 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683a6f6-5075-4cc1-aee6-9197b94cbcf1 admin admin] PATH_INFO: `/v3/projects/238d1ec78709478f93633c7eb6ff365c/users/f082354d2ddd4cc8b8ca29c87c3636be/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:23.206893 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683a6f6-5075-4cc1-aee6-9197b94cbcf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=238d1ec78709478f93633c7eb6ff365c, user_id=f082354d2ddd4cc8b8ca29c87c3636be, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:23.209600 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683a6f6-5075-4cc1-aee6-9197b94cbcf1 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:23.320774 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1426/2849] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:40:23 2022] PUT /identity/v3/projects/238d1ec78709478f93633c7eb6ff365c/users/f082354d2ddd4cc8b8ca29c87c3636be/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:23.332021 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32c58-6dd9-422f-a93f-cf6d31574b62 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:23.332317 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32c58-6dd9-422f-a93f-cf6d31574b62 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:23.332601 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32c58-6dd9-422f-a93f-cf6d31574b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:23.359904 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-24d32c58-6dd9-422f-a93f-cf6d31574b62 None None] MFA Rules not processed for user `f082354d2ddd4cc8b8ca29c87c3636be`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:23.361112 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-24d32c58-6dd9-422f-a93f-cf6d31574b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:23.424248 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1424/2850] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:23.435556 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683a6f6-5075-4cc1-aee6-9197b94cbcf1 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:23.437344 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8683a6f6-5075-4cc1-aee6-9197b94cbcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:23.491666 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683a6f6-5075-4cc1-aee6-9197b94cbcf1 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:23.495255 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d2098-1db4-48ab-999d-6e62e739de4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:23.495891 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d2098-1db4-48ab-999d-6e62e739de4c service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:23.496171 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d2098-1db4-48ab-999d-6e62e739de4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:23.496452 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d2098-1db4-48ab-999d-6e62e739de4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:23.504464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d2098-1db4-48ab-999d-6e62e739de4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:23.506520 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d2098-1db4-48ab-999d-6e62e739de4c service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:23.515016 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1427/2851] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:40:34.203240 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32c58-6dd9-422f-a93f-cf6d31574b62 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:34.262269 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32c58-6dd9-422f-a93f-cf6d31574b62 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:34.266608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:34.267505 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:34.267780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:34.268053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] PATH_INFO: `/v3/users/f082354d2ddd4cc8b8ca29c87c3636be` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:34.269220 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f082354d2ddd4cc8b8ca29c87c3636be)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:34.271178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:34.494020 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f082354d2ddd4cc8b8ca29c87c3636be'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:34.505543 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f082354d2ddd4cc8b8ca29c87c3636be'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:34.512404 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f082354d2ddd4cc8b8ca29c87c3636be'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:34.513070 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f082354d2ddd4cc8b8ca29c87c3636be'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:34.600719 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f082354d2ddd4cc8b8ca29c87c3636be'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:34.607019 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1425/2852] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:40:34 2022] DELETE /identity/v3/users/f082354d2ddd4cc8b8ca29c87c3636be => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:34.611616 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d375f-eb13-4ff7-88a2-f5157f39a16d None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:34.615924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d375f-eb13-4ff7-88a2-f5157f39a16d None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:34.615924 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d375f-eb13-4ff7-88a2-f5157f39a16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:34.629146 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-936d375f-eb13-4ff7-88a2-f5157f39a16d None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:34.630453 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-936d375f-eb13-4ff7-88a2-f5157f39a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:34.687512 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1428/2853] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:40:34.697133 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:34.698521 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:34.757135 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93f7c-453a-41b8-b885-8d72c298a94f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:34.760877 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edcc60-b3e6-42d5-b67a-27d7660a12d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:34.761527 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcc60-b3e6-42d5-b67a-27d7660a12d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:34.761814 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcc60-b3e6-42d5-b67a-27d7660a12d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:34.762095 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcc60-b3e6-42d5-b67a-27d7660a12d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:34.776329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edcc60-b3e6-42d5-b67a-27d7660a12d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:34.776329 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edcc60-b3e6-42d5-b67a-27d7660a12d2 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:34.782726 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1426/2854] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:40:35.161765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d375f-eb13-4ff7-88a2-f5157f39a16d None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:35.163290 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-936d375f-eb13-4ff7-88a2-f5157f39a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:35.175261 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d375f-eb13-4ff7-88a2-f5157f39a16d None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:35.179878 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:35.180747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:35.181029 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:35.181304 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] PATH_INFO: `/v3/projects/238d1ec78709478f93633c7eb6ff365c` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:35.182546 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=238d1ec78709478f93633c7eb6ff365c)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:35.187539 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:35.287190 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238d1ec78709478f93633c7eb6ff365c', 'request_id': 'req-d14a73bf-cb8a-467a-b974-a0c2df708048'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:35.292423 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238d1ec78709478f93633c7eb6ff365c', 'request_id': 'req-d14a73bf-cb8a-467a-b974-a0c2df708048'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:35.371756 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238d1ec78709478f93633c7eb6ff365c', 'request_id': 'req-d14a73bf-cb8a-467a-b974-a0c2df708048'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:35.383588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] The token cache is being invalidate because project 238d1ec78709478f93633c7eb6ff365c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:40:35.383900 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:35.384541 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-d14a73bf-cb8a-467a-b974-a0c2df708048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:40:35.386088 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1429/2855] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:40:35 2022] DELETE /identity/v3/projects/238d1ec78709478f93633c7eb6ff365c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:35.391984 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164f942-ab6c-483f-b137-eb1c3df75565 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:35.392471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164f942-ab6c-483f-b137-eb1c3df75565 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:35.392577 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164f942-ab6c-483f-b137-eb1c3df75565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:35.409828 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9164f942-ab6c-483f-b137-eb1c3df75565 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:35.411081 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9164f942-ab6c-483f-b137-eb1c3df75565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:35.467433 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1427/2856] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:40:35.475252 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb58350-6bf6-4077-af82-3c14f0edc1ad None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:35.475557 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb58350-6bf6-4077-af82-3c14f0edc1ad None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:35.475846 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb58350-6bf6-4077-af82-3c14f0edc1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:35.494486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-beb58350-6bf6-4077-af82-3c14f0edc1ad None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:35.495720 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-beb58350-6bf6-4077-af82-3c14f0edc1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:35.503565 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1430/2857] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:35.508117 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164f942-ab6c-483f-b137-eb1c3df75565 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:35.517465 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164f942-ab6c-483f-b137-eb1c3df75565 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:35.522129 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1407e35-5dde-4bde-94e1-296bff5fb5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:35.523106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1407e35-5dde-4bde-94e1-296bff5fb5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:35.523106 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1407e35-5dde-4bde-94e1-296bff5fb5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:35.523337 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1407e35-5dde-4bde-94e1-296bff5fb5f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:35.524058 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1407e35-5dde-4bde-94e1-296bff5fb5f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:40:35.524367 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1407e35-5dde-4bde-94e1-296bff5fb5f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:35.526027 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1407e35-5dde-4bde-94e1-296bff5fb5f7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:35.537410 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1428/2858] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:40:35.541504 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb58350-6bf6-4077-af82-3c14f0edc1ad None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:35.550904 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb58350-6bf6-4077-af82-3c14f0edc1ad None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:35.556098 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f99fd-7031-4d15-841c-92f37bffa3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:35.556741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f99fd-7031-4d15-841c-92f37bffa3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:35.557027 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f99fd-7031-4d15-841c-92f37bffa3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:35.557310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f99fd-7031-4d15-841c-92f37bffa3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:35.558011 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f99fd-7031-4d15-841c-92f37bffa3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:35.559963 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f99fd-7031-4d15-841c-92f37bffa3b9 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:35.636866 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1431/2859] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:40:35 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:40:35.640968 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1407e35-5dde-4bde-94e1-296bff5fb5f7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:35.651005 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1407e35-5dde-4bde-94e1-296bff5fb5f7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:35.705069 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ef578-74eb-4493-bce5-57e351a736f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:35.705735 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef578-74eb-4493-bce5-57e351a736f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:35.706019 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef578-74eb-4493-bce5-57e351a736f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:35.706302 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef578-74eb-4493-bce5-57e351a736f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:35.706984 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ef578-74eb-4493-bce5-57e351a736f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:35.708981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ef578-74eb-4493-bce5-57e351a736f8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:35.794856 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1429/2860] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:40:35 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:40:35.802447 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f99fd-7031-4d15-841c-92f37bffa3b9 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:35.812594 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f99fd-7031-4d15-841c-92f37bffa3b9 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:35.817164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306852c4-2a81-4048-8b2c-013fc5d22465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:35.817838 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306852c4-2a81-4048-8b2c-013fc5d22465 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:35.818118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306852c4-2a81-4048-8b2c-013fc5d22465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:35.818393 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306852c4-2a81-4048-8b2c-013fc5d22465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:35.819114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306852c4-2a81-4048-8b2c-013fc5d22465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:35.820749 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306852c4-2a81-4048-8b2c-013fc5d22465 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:35.831702 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1432/2861] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:35.835514 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ef578-74eb-4493-bce5-57e351a736f8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:35.845446 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ef578-74eb-4493-bce5-57e351a736f8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:35.850602 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c6df8-61a4-483a-9ff6-bd595fc3e82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:35.851290 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c6df8-61a4-483a-9ff6-bd595fc3e82c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:35.851575 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c6df8-61a4-483a-9ff6-bd595fc3e82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:35.851852 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c6df8-61a4-483a-9ff6-bd595fc3e82c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:35.852576 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c6df8-61a4-483a-9ff6-bd595fc3e82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:35.854188 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c6df8-61a4-483a-9ff6-bd595fc3e82c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:35.864760 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1430/2862] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:40:35.868883 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306852c4-2a81-4048-8b2c-013fc5d22465 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:35.878641 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306852c4-2a81-4048-8b2c-013fc5d22465 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:35.883289 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0def-d665-4236-a6a9-748bc7200d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:35.884164 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0def-d665-4236-a6a9-748bc7200d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:35.884467 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0def-d665-4236-a6a9-748bc7200d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:35.884728 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b0def-d665-4236-a6a9-748bc7200d39 admin admin] PATH_INFO: `/v3/projects/491ef7d5e64b42338858c6dcd8b7d932/users/fa48c3674f1f4aa99d920b59990ad16e/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:35.899143 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b0def-d665-4236-a6a9-748bc7200d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491ef7d5e64b42338858c6dcd8b7d932, user_id=fa48c3674f1f4aa99d920b59990ad16e, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:35.901985 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b0def-d665-4236-a6a9-748bc7200d39 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:35.966706 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1433/2863] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:40:35 2022] PUT /identity/v3/projects/491ef7d5e64b42338858c6dcd8b7d932/users/fa48c3674f1f4aa99d920b59990ad16e/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:40:35.982083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e527ae-c318-4340-9973-e693f6105d2e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:35.982083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e527ae-c318-4340-9973-e693f6105d2e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:35.982083 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e527ae-c318-4340-9973-e693f6105d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:36.007399 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-73e527ae-c318-4340-9973-e693f6105d2e None None] MFA Rules not processed for user `fa48c3674f1f4aa99d920b59990ad16e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:40:36.008625 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-73e527ae-c318-4340-9973-e693f6105d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:36.071561 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1431/2864] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:40:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:40:36.083990 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0def-d665-4236-a6a9-748bc7200d39 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:36.085735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-c70b0def-d665-4236-a6a9-748bc7200d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:36.146785 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b0def-d665-4236-a6a9-748bc7200d39 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:36.150602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134a172-635b-4eec-9f2f-7725768fa89d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e00de466abe41da8e6d7dbbd71f5270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:36.151285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a172-635b-4eec-9f2f-7725768fa89d service glance] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:36.151575 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a172-635b-4eec-9f2f-7725768fa89d service glance] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:36.151858 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a172-635b-4eec-9f2f-7725768fa89d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:36.160336 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134a172-635b-4eec-9f2f-7725768fa89d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:36.163941 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134a172-635b-4eec-9f2f-7725768fa89d service glance] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:36.177325 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1434/2865] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:40:51.477025 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e527ae-c318-4340-9973-e693f6105d2e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:40:51.478140 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-73e527ae-c318-4340-9973-e693f6105d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:51.571472 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e527ae-c318-4340-9973-e693f6105d2e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:40:51.576616 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c1a35-73a4-4cb3-95da-0315be034c9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84ae21424694df68a96b928e15e9240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:40:51.577266 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1a35-73a4-4cb3-95da-0315be034c9c service placement] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:40:51.577552 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1a35-73a4-4cb3-95da-0315be034c9c service placement] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:40:51.577831 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1a35-73a4-4cb3-95da-0315be034c9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:40:51.579618 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c31c1a35-73a4-4cb3-95da-0315be034c9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:40:51.591586 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c1a35-73a4-4cb3-95da-0315be034c9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:40:51.593200 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c1a35-73a4-4cb3-95da-0315be034c9c service placement] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:40:51.603009 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1432/2866] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:40:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:41:11.454210 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134a172-635b-4eec-9f2f-7725768fa89d service glance] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:11.513596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134a172-635b-4eec-9f2f-7725768fa89d service glance] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:11.518110 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:11.518970 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:11.519283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:11.519568 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] PATH_INFO: `/v3/users/fa48c3674f1f4aa99d920b59990ad16e` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:11.520747 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa48c3674f1f4aa99d920b59990ad16e)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:11.522673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:11.764416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa48c3674f1f4aa99d920b59990ad16e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:11.776348 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa48c3674f1f4aa99d920b59990ad16e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:11.777018 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa48c3674f1f4aa99d920b59990ad16e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:11.842475 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa48c3674f1f4aa99d920b59990ad16e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:11.849677 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa48c3674f1f4aa99d920b59990ad16e'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:11.855673 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1435/2867] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:41:11 2022] DELETE /identity/v3/users/fa48c3674f1f4aa99d920b59990ad16e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:41:11.860662 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36434a-bcde-4ce2-b814-1d26f1758ea0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:11.861122 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36434a-bcde-4ce2-b814-1d26f1758ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:11.861247 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36434a-bcde-4ce2-b814-1d26f1758ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:11.879905 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1b36434a-bcde-4ce2-b814-1d26f1758ea0 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:41:11.881100 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1b36434a-bcde-4ce2-b814-1d26f1758ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:11.939285 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1433/2868] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 17:41:11.949623 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:11.953049 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:12.012281 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b00b4-87d2-46a3-9289-0b36d82ceeb1 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:12.015960 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae637988-5743-443a-aec1-ff2dd047c990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:12.016559 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae637988-5743-443a-aec1-ff2dd047c990 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:12.016843 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae637988-5743-443a-aec1-ff2dd047c990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:12.017118 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae637988-5743-443a-aec1-ff2dd047c990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:12.026138 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae637988-5743-443a-aec1-ff2dd047c990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:12.027626 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae637988-5743-443a-aec1-ff2dd047c990 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:12.036828 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1436/2869] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:41:12.427890 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36434a-bcde-4ce2-b814-1d26f1758ea0 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:12.429362 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1b36434a-bcde-4ce2-b814-1d26f1758ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:12.441802 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36434a-bcde-4ce2-b814-1d26f1758ea0 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:12.446589 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:12.447795 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:12.448087 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:12.448363 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] PATH_INFO: `/v3/projects/491ef7d5e64b42338858c6dcd8b7d932` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:12.449564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491ef7d5e64b42338858c6dcd8b7d932)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:12.451539 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:12.579953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491ef7d5e64b42338858c6dcd8b7d932', 'request_id': 'req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:12.585176 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491ef7d5e64b42338858c6dcd8b7d932', 'request_id': 'req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:12.631672 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491ef7d5e64b42338858c6dcd8b7d932', 'request_id': 'req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:12.643780 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] The token cache is being invalidate because project 491ef7d5e64b42338858c6dcd8b7d932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:41:12.644066 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:12.644695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-233f3bc2-c9b9-42b9-89f6-06c6ba1bf237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:12.646300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1434/2870] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:41:12 2022] DELETE /identity/v3/projects/491ef7d5e64b42338858c6dcd8b7d932 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:41:12.651814 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b09aa-2cc0-4a99-8758-56b719cc5cb1 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:12.652298 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b09aa-2cc0-4a99-8758-56b719cc5cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:12.652427 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b09aa-2cc0-4a99-8758-56b719cc5cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:12.669320 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-8d0b09aa-2cc0-4a99-8758-56b719cc5cb1 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:41:12.670503 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8d0b09aa-2cc0-4a99-8758-56b719cc5cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:12.726386 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1437/2871] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:41:12.734300 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9222c-a3c6-427b-88db-9ab4500cb758 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:12.734593 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9222c-a3c6-427b-88db-9ab4500cb758 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:12.734872 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9222c-a3c6-427b-88db-9ab4500cb758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:12.753280 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-25c9222c-a3c6-427b-88db-9ab4500cb758 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:41:12.754483 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-25c9222c-a3c6-427b-88db-9ab4500cb758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:12.763025 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1435/2872] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:41:12.767041 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b09aa-2cc0-4a99-8758-56b719cc5cb1 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:12.776602 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b09aa-2cc0-4a99-8758-56b719cc5cb1 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:12.781271 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1439ae-cd42-4b98-8e1f-da74fa1a313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:12.781933 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1439ae-cd42-4b98-8e1f-da74fa1a313f admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:12.782220 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1439ae-cd42-4b98-8e1f-da74fa1a313f admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:12.782500 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1439ae-cd42-4b98-8e1f-da74fa1a313f admin admin] PATH_INFO: `/v3/domains` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:12.783265 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1439ae-cd42-4b98-8e1f-da74fa1a313f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 17:41:12.783585 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1439ae-cd42-4b98-8e1f-da74fa1a313f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:12.785201 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1439ae-cd42-4b98-8e1f-da74fa1a313f admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:12.796464 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1438/2873] 10.222.0.64 () {58 vars in 1152 bytes} [Fri May 13 17:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 17:41:12.800686 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9222c-a3c6-427b-88db-9ab4500cb758 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:12.810149 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9222c-a3c6-427b-88db-9ab4500cb758 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:12.814907 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b3f32-51dc-4ac0-8dd5-823357ff4fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:12.815695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b3f32-51dc-4ac0-8dd5-823357ff4fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:12.815981 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b3f32-51dc-4ac0-8dd5-823357ff4fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:12.816255 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b3f32-51dc-4ac0-8dd5-823357ff4fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:12.816950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b3f32-51dc-4ac0-8dd5-823357ff4fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:12.819245 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b3f32-51dc-4ac0-8dd5-823357ff4fa2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:12.895413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1436/2874] 10.222.0.64 () {60 vars in 1152 bytes} [Fri May 13 17:41:12 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 17:41:12.899441 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1439ae-cd42-4b98-8e1f-da74fa1a313f admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:12.909588 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1439ae-cd42-4b98-8e1f-da74fa1a313f admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:12.965780 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823cb20-a50e-40f6-825e-895a067e95a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:12.966453 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823cb20-a50e-40f6-825e-895a067e95a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:12.966741 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823cb20-a50e-40f6-825e-895a067e95a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:12.967083 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823cb20-a50e-40f6-825e-895a067e95a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:12.967815 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823cb20-a50e-40f6-825e-895a067e95a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:12.969837 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823cb20-a50e-40f6-825e-895a067e95a8 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:13.074532 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1439/2875] 10.222.0.64 () {60 vars in 1143 bytes} [Fri May 13 17:41:12 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 17:41:13.078583 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b3f32-51dc-4ac0-8dd5-823357ff4fa2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:13.091509 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b3f32-51dc-4ac0-8dd5-823357ff4fa2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:13.096459 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca1d1f-d6e6-45e4-be58-92992a4a0178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:13.097160 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1d1f-d6e6-45e4-be58-92992a4a0178 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:13.097445 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1d1f-d6e6-45e4-be58-92992a4a0178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:13.097724 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1d1f-d6e6-45e4-be58-92992a4a0178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:13.098471 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca1d1f-d6e6-45e4-be58-92992a4a0178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:13.100178 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca1d1f-d6e6-45e4-be58-92992a4a0178 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:13.110899 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1437/2876] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:41:13.114840 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823cb20-a50e-40f6-825e-895a067e95a8 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:13.124650 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823cb20-a50e-40f6-825e-895a067e95a8 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:13.129162 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3945f-56b5-47dc-9d20-9bbd129178b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:13.129810 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3945f-56b5-47dc-9d20-9bbd129178b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:13.130089 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3945f-56b5-47dc-9d20-9bbd129178b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:13.130360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3945f-56b5-47dc-9d20-9bbd129178b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:13.131076 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3945f-56b5-47dc-9d20-9bbd129178b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:13.132683 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3945f-56b5-47dc-9d20-9bbd129178b6 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:13.142801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1440/2877] 10.222.0.64 () {58 vars in 1121 bytes} [Fri May 13 17:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 17:41:13.146810 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca1d1f-d6e6-45e4-be58-92992a4a0178 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:13.157111 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca1d1f-d6e6-45e4-be58-92992a4a0178 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:13.161714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2b63b-8397-420d-ab47-99033ad0826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:13.162590 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2b63b-8397-420d-ab47-99033ad0826c admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:13.162866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2b63b-8397-420d-ab47-99033ad0826c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:13.163174 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2b63b-8397-420d-ab47-99033ad0826c admin admin] PATH_INFO: `/v3/projects/10c85dea3f064cd69dd9a4c59d6ea190/users/1ed63abb63e1452eb265b5a5522b494e/roles/52bafac2651a4075879b7d97a4f9111e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:13.177282 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2b63b-8397-420d-ab47-99033ad0826c admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c85dea3f064cd69dd9a4c59d6ea190, user_id=1ed63abb63e1452eb265b5a5522b494e, role_id=52bafac2651a4075879b7d97a4f9111e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:13.180005 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2b63b-8397-420d-ab47-99033ad0826c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:13.245695 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1438/2878] 10.222.0.64 () {60 vars in 1482 bytes} [Fri May 13 17:41:13 2022] PUT /identity/v3/projects/10c85dea3f064cd69dd9a4c59d6ea190/users/1ed63abb63e1452eb265b5a5522b494e/roles/52bafac2651a4075879b7d97a4f9111e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:41:13.255986 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8becb-6427-4265-9751-d76f091974f2 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:13.257322 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8becb-6427-4265-9751-d76f091974f2 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:13.257322 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8becb-6427-4265-9751-d76f091974f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:13.284732 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-0dc8becb-6427-4265-9751-d76f091974f2 None None] MFA Rules not processed for user `1ed63abb63e1452eb265b5a5522b494e`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:41:13.285938 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-0dc8becb-6427-4265-9751-d76f091974f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:13.349721 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1441/2879] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:41:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:41:13.360680 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2b63b-8397-420d-ab47-99033ad0826c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:13.362353 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-84a2b63b-8397-420d-ab47-99033ad0826c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:13.416797 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2b63b-8397-420d-ab47-99033ad0826c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:13.420400 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642b424-7f3c-46d2-a20f-8dec3db7112e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:13.421038 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642b424-7f3c-46d2-a20f-8dec3db7112e service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:13.421324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642b424-7f3c-46d2-a20f-8dec3db7112e service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:13.421603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642b424-7f3c-46d2-a20f-8dec3db7112e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:13.429799 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642b424-7f3c-46d2-a20f-8dec3db7112e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:13.431816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642b424-7f3c-46d2-a20f-8dec3db7112e service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:13.440396 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1439/2880] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:41:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:41:19.309596 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8becb-6427-4265-9751-d76f091974f2 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:19.319627 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8becb-6427-4265-9751-d76f091974f2 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:19.323185 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c10cdf-05a0-44a6-8b56-ecd323a60ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd116be69d7f4cffb770940ccb7514fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:19.323827 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c10cdf-05a0-44a6-8b56-ecd323a60ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:19.324114 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c10cdf-05a0-44a6-8b56-ecd323a60ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:19.324392 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c10cdf-05a0-44a6-8b56-ecd323a60ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:19.326131 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-06c10cdf-05a0-44a6-8b56-ecd323a60ed1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:19.385729 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c10cdf-05a0-44a6-8b56-ecd323a60ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:19.387219 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c10cdf-05a0-44a6-8b56-ecd323a60ed1 service cinder] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:19.396135 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1442/2881] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:41:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:41:38.089555 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7caa-57bf-4824-9996-912a6370b7fb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:38.090053 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7caa-57bf-4824-9996-912a6370b7fb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:38.090159 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7caa-57bf-4824-9996-912a6370b7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:38.110731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-47df7caa-57bf-4824-9996-912a6370b7fb None None] MFA Rules not processed for user `45482c562be6438ebd456ee9512ef3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:41:38.110731 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-47df7caa-57bf-4824-9996-912a6370b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:38.116985 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1440/2882] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:41:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:41:38.432826 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c10cdf-05a0-44a6-8b56-ecd323a60ed1 service cinder] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:38.434930 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-06c10cdf-05a0-44a6-8b56-ecd323a60ed1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:38.498862 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c10cdf-05a0-44a6-8b56-ecd323a60ed1 service cinder] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:38.506460 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588038f-11e8-41f1-85a1-eef786f19a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:38.507149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588038f-11e8-41f1-85a1-eef786f19a9c service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:38.512773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588038f-11e8-41f1-85a1-eef786f19a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:38.512773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588038f-11e8-41f1-85a1-eef786f19a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:38.512773 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-8588038f-11e8-41f1-85a1-eef786f19a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:38.521718 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588038f-11e8-41f1-85a1-eef786f19a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:38.523193 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588038f-11e8-41f1-85a1-eef786f19a9c service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:38.531181 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1443/2883] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:41:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:41:40.236896 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df7caa-57bf-4824-9996-912a6370b7fb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:40.242125 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-47df7caa-57bf-4824-9996-912a6370b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:40.250456 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df7caa-57bf-4824-9996-912a6370b7fb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:40.254932 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6223114-88a0-4777-bb44-f2b567b061c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:40.255621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6223114-88a0-4777-bb44-f2b567b061c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:40.255911 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6223114-88a0-4777-bb44-f2b567b061c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:40.256193 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6223114-88a0-4777-bb44-f2b567b061c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:40.257950 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f6223114-88a0-4777-bb44-f2b567b061c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:40.330603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6223114-88a0-4777-bb44-f2b567b061c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:40.332357 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6223114-88a0-4777-bb44-f2b567b061c1 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:40.344137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1441/2884] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:41:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:41:41.449025 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588038f-11e8-41f1-85a1-eef786f19a9c service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:41.458209 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588038f-11e8-41f1-85a1-eef786f19a9c service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:41.465412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dac5d-d0eb-49e4-9eea-8d9eee5bf5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:41.465412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dac5d-d0eb-49e4-9eea-8d9eee5bf5dd service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:41.465412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dac5d-d0eb-49e4-9eea-8d9eee5bf5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:41.465412 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dac5d-d0eb-49e4-9eea-8d9eee5bf5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:41.465834 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-eb9dac5d-d0eb-49e4-9eea-8d9eee5bf5dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:41.479149 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dac5d-d0eb-49e4-9eea-8d9eee5bf5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:41.480608 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dac5d-d0eb-49e4-9eea-8d9eee5bf5dd service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:41.492470 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1444/2885] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:41:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:41:43.264068 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6223114-88a0-4777-bb44-f2b567b061c1 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:43.339782 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6223114-88a0-4777-bb44-f2b567b061c1 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:43.344507 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:43.345466 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:43.345821 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:43.346169 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] PATH_INFO: `/v3/users/1ed63abb63e1452eb265b5a5522b494e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:43.347498 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed63abb63e1452eb265b5a5522b494e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:43.349517 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:43.536878 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed63abb63e1452eb265b5a5522b494e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:43.549017 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed63abb63e1452eb265b5a5522b494e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:43.556137 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed63abb63e1452eb265b5a5522b494e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:43.557128 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed63abb63e1452eb265b5a5522b494e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:43.654523 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed63abb63e1452eb265b5a5522b494e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:43.661882 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1442/2886] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:41:43 2022] DELETE /identity/v3/users/1ed63abb63e1452eb265b5a5522b494e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:41:43.666844 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a0538-955a-49fc-9741-0feeb5638632 None None] REQUEST_METHOD: `POST` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:43.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a0538-955a-49fc-9741-0feeb5638632 None None] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:43.667438 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a0538-955a-49fc-9741-0feeb5638632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:43.695629 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.auth.core [None req-b45a0538-955a-49fc-9741-0feeb5638632 None None] MFA Rules not processed for user `3163ceb80e1143e28503836c92928e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 17:41:43.697448 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b45a0538-955a-49fc-9741-0feeb5638632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:43.784486 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1445/2887] 10.222.0.64 () {58 vars in 957 bytes} [Fri May 13 17:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 17:41:43.796239 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:43.797666 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:43.861816 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee87c81-8225-44ee-9c93-69ee4bd6fdd1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:43.865964 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b501137-6d67-4670-92cf-0da1db670eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:43.866607 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b501137-6d67-4670-92cf-0da1db670eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:43.866886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b501137-6d67-4670-92cf-0da1db670eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:43.867186 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b501137-6d67-4670-92cf-0da1db670eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:43.877578 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b501137-6d67-4670-92cf-0da1db670eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:43.879499 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b501137-6d67-4670-92cf-0da1db670eb4 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:43.894177 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1443/2888] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:41:44.370610 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a0538-955a-49fc-9741-0feeb5638632 None None] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:41:44.372419 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-b45a0538-955a-49fc-9741-0feeb5638632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:41:44.400061 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a0538-955a-49fc-9741-0feeb5638632 None None] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:41:44.408342 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:41:44.409445 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:41:44.409910 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:41:44.410388 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] PATH_INFO: `/v3/projects/10c85dea3f064cd69dd9a4c59d6ea190` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:41:44.412592 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c85dea3f064cd69dd9a4c59d6ea190)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:41:44.415832 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:41:44.526766 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c85dea3f064cd69dd9a4c59d6ea190', 'request_id': 'req-f5b4a461-a838-43db-b0a1-86eafff7b74a'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:44.533068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c85dea3f064cd69dd9a4c59d6ea190', 'request_id': 'req-f5b4a461-a838-43db-b0a1-86eafff7b74a'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:44.605387 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c85dea3f064cd69dd9a4c59d6ea190', 'request_id': 'req-f5b4a461-a838-43db-b0a1-86eafff7b74a'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:44.617285 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] The token cache is being invalidate because project 10c85dea3f064cd69dd9a4c59d6ea190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:41:44.617573 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:44.618202 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:41:44.619802 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1446/2889] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:41:44 2022] DELETE /identity/v3/projects/10c85dea3f064cd69dd9a4c59d6ea190 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:42:00.342793 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b501137-6d67-4670-92cf-0da1db670eb4 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:42:00.351867 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b501137-6d67-4670-92cf-0da1db670eb4 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:42:00.399678 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad7417-da48-498b-a4f3-e2827d52650c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:42:00.400324 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad7417-da48-498b-a4f3-e2827d52650c service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:42:00.400608 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad7417-da48-498b-a4f3-e2827d52650c service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:42:00.400887 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad7417-da48-498b-a4f3-e2827d52650c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:42:00.402682 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2dad7417-da48-498b-a4f3-e2827d52650c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:42:00.464806 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad7417-da48-498b-a4f3-e2827d52650c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:42:00.466276 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad7417-da48-498b-a4f3-e2827d52650c service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:42:00.476398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1444/2890] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:42:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:42:52.196225 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:42:52.197734 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:42:52.210055 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4a461-a838-43db-b0a1-86eafff7b74a admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:42:52.213703 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fdd8a-646d-4cb8-94e6-ce56927aef07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:42:52.214378 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fdd8a-646d-4cb8-94e6-ce56927aef07 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:42:52.214663 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fdd8a-646d-4cb8-94e6-ce56927aef07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:42:52.214942 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fdd8a-646d-4cb8-94e6-ce56927aef07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:42:52.216710 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-2a4fdd8a-646d-4cb8-94e6-ce56927aef07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:42:52.226620 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fdd8a-646d-4cb8-94e6-ce56927aef07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:42:52.231235 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fdd8a-646d-4cb8-94e6-ce56927aef07 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:42:52.236788 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1447/2891] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:42:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:43:53.800423 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad7417-da48-498b-a4f3-e2827d52650c service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:43:53.802121 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2dad7417-da48-498b-a4f3-e2827d52650c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:43:53.881109 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad7417-da48-498b-a4f3-e2827d52650c service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:43:53.886975 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b26f1-6924-4305-9871-379b61ed9da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbbecde248c44c7b1d5f3c9522a48a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:43:53.887687 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b26f1-6924-4305-9871-379b61ed9da4 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:43:53.887974 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b26f1-6924-4305-9871-379b61ed9da4 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:43:53.888250 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b26f1-6924-4305-9871-379b61ed9da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:43:53.890166 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ca6b26f1-6924-4305-9871-379b61ed9da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:43:53.904054 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b26f1-6924-4305-9871-379b61ed9da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:43:53.905714 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b26f1-6924-4305-9871-379b61ed9da4 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:43:53.917709 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1445/2892] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:43:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:44:08.115648 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fdd8a-646d-4cb8-94e6-ce56927aef07 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:44:08.125246 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fdd8a-646d-4cb8-94e6-ce56927aef07 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:44:08.129074 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0093b5-645c-41b2-a748-5091410731a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99855838f77462886cc87db440e1037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:44:08.129714 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0093b5-645c-41b2-a748-5091410731a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:44:08.130003 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0093b5-645c-41b2-a748-5091410731a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:44:08.130283 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0093b5-645c-41b2-a748-5091410731a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:44:08.132083 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-5c0093b5-645c-41b2-a748-5091410731a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:44:08.193896 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0093b5-645c-41b2-a748-5091410731a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:44:08.195401 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0093b5-645c-41b2-a748-5091410731a5 service neutron] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:44:08.205544 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1448/2893] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 17:44:15.426398 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b26f1-6924-4305-9871-379b61ed9da4 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:44:15.428388 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ca6b26f1-6924-4305-9871-379b61ed9da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:44:15.444751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b26f1-6924-4305-9871-379b61ed9da4 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:44:15.449115 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:44:15.449989 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:44:15.450270 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:44:15.450547 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] PATH_INFO: `/v3/users/45482c562be6438ebd456ee9512ef3e8` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:44:15.451751 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=45482c562be6438ebd456ee9512ef3e8)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:44:15.453694 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:44:15.638226 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45482c562be6438ebd456ee9512ef3e8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:15.649896 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45482c562be6438ebd456ee9512ef3e8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:15.657222 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45482c562be6438ebd456ee9512ef3e8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:15.657886 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45482c562be6438ebd456ee9512ef3e8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:15.739574 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45482c562be6438ebd456ee9512ef3e8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:15.745621 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1446/2894] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:44:15 2022] DELETE /identity/v3/users/45482c562be6438ebd456ee9512ef3e8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:44:15.993093 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0093b5-645c-41b2-a748-5091410731a5 service neutron] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:44:16.006961 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0093b5-645c-41b2-a748-5091410731a5 service neutron] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:44:16.061877 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:44:16.062740 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:44:16.063024 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:44:16.063330 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] PATH_INFO: `/v3/projects/60fd06693c624da5aa61222dfbde5b25` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:44:16.064510 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fd06693c624da5aa61222dfbde5b25)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:44:16.066420 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:44:16.158454 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fd06693c624da5aa61222dfbde5b25', 'request_id': 'req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:16.165967 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fd06693c624da5aa61222dfbde5b25', 'request_id': 'req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:16.225267 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fd06693c624da5aa61222dfbde5b25', 'request_id': 'req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:16.237323 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] The token cache is being invalidate because project 60fd06693c624da5aa61222dfbde5b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:44:16.237612 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:16.238284 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:16.240068 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1449/2895] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:44:15 2022] DELETE /identity/v3/projects/60fd06693c624da5aa61222dfbde5b25 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:44:16.244206 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:44:16.245564 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:44:16.258866 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616d935-e123-41e0-ae40-b45b4a82d7ae admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:44:16.313953 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:44:16.314832 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:44:16.315145 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:44:16.315428 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] PATH_INFO: `/v3/users/25dc88c37a754f02953fb0d8765d2653` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:44:16.316618 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25dc88c37a754f02953fb0d8765d2653)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:44:16.318582 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:44:16.477819 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25dc88c37a754f02953fb0d8765d2653'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:16.489426 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25dc88c37a754f02953fb0d8765d2653'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:16.496041 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25dc88c37a754f02953fb0d8765d2653'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:16.496655 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25dc88c37a754f02953fb0d8765d2653'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:16.533413 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25dc88c37a754f02953fb0d8765d2653'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:16.539335 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1447/2896] 10.222.0.64 () {58 vars in 1223 bytes} [Fri May 13 17:44:16 2022] DELETE /identity/v3/users/25dc88c37a754f02953fb0d8765d2653 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:44:16.786607 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] Authenticating user token {{(pid=80073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:44:16.788542 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.fernet_utils [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:44:16.810631 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ed99e-6a55-47a9-8248-cc3a7e63f6f7 admin admin] Validating token access rules against request {{(pid=80073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:44:16.869174 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3163ceb80e1143e28503836c92928e92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1067556b2a41588af4e1e6fd0de9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:44:16.870032 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:44:16.870310 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] SCRIPT_NAME: `/identity` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:44:16.870579 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] PATH_INFO: `/v3/projects/3beeaeb8a8bc41b08f7d9b6cb0780214` {{(pid=80073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:44:16.871765 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3beeaeb8a8bc41b08f7d9b6cb0780214)` {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:44:16.874360 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] RBAC: Authorization granted {{(pid=80073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:44:16.973404 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3beeaeb8a8bc41b08f7d9b6cb0780214', 'request_id': 'req-bbdbb18a-17b5-4741-bf71-384fd0a2344d'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:16.978735 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3beeaeb8a8bc41b08f7d9b6cb0780214', 'request_id': 'req-bbdbb18a-17b5-4741-bf71-384fd0a2344d'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:17.036416 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3beeaeb8a8bc41b08f7d9b6cb0780214', 'request_id': 'req-bbdbb18a-17b5-4741-bf71-384fd0a2344d'} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:17.047515 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] The token cache is being invalidate because project 3beeaeb8a8bc41b08f7d9b6cb0780214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 17:44:17.047801 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:17.048450 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: DEBUG keystone.notifications [None req-bbdbb18a-17b5-4741-bf71-384fd0a2344d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 17:44:17.049988 dv-cinder-841782-1-iscsi devstack@keystone.service[80073]: [pid: 80073|app: 0|req: 1450/2897] 10.222.0.64 () {58 vars in 1232 bytes} [Fri May 13 17:44:16 2022] DELETE /identity/v3/projects/3beeaeb8a8bc41b08f7d9b6cb0780214 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 17:45:57.540603 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 17:45:57.542046 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:45:57.608478 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1031cbe-75c3-4144-bf6d-cca9317ec8a9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 17:45:57.663992 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f75444-fe99-49ba-8ec4-c88a4be34069 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84ae21424694df68a96b928e15e9240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d1800939cad4368b4eafe8b6dfe12c3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 17:45:57.664658 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75444-fe99-49ba-8ec4-c88a4be34069 service placement] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 17:45:57.664939 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75444-fe99-49ba-8ec4-c88a4be34069 service placement] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 17:45:57.665212 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75444-fe99-49ba-8ec4-c88a4be34069 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 17:45:57.666971 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-39f75444-fe99-49ba-8ec4-c88a4be34069 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 17:45:57.678288 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f75444-fe99-49ba-8ec4-c88a4be34069 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 17:45:57.679931 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f75444-fe99-49ba-8ec4-c88a4be34069 service placement] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 17:45:57.689649 dv-cinder-841782-1-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1448/2898] 10.222.0.64 () {60 vars in 1365 bytes} [Fri May 13 17:45:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)